Jul 31 14:43:01 devstack cinder-volume[77526]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 31 14:43:01 devstack cinder-volume[77526]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 31 14:43:01 devstack cinder-volume[77526]: we strongly recommend against using it for new projects.
Jul 31 14:43:01 devstack cinder-volume[77526]: If you are already using Eventlet, we recommend migrating to a different
Jul 31 14:43:01 devstack cinder-volume[77526]: framework.  For more detail see
Jul 31 14:43:01 devstack cinder-volume[77526]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 31 14:43:01 devstack cinder-volume[77526]:   import eventlet  # noqa
Jul 31 14:43:04 devstack cinder-volume[77526]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 31 14:43:04 devstack cinder-volume[77526]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 31 14:43:04 devstack cinder-volume[77526]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 31 14:43:05 devstack cinder-volume[77526]: INFO dbcounter [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Registered counter for database cinder
Jul 31 14:43:05 devstack cinder-volume[77526]: DEBUG oslo_db.sqlalchemy.engines [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:43:05 devstack cinder-volume[77526]: DEBUG dbcounter [-] [77526] Writer thread running {{(pid=77526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 31 14:43:05 devstack cinder-volume[77526]: INFO cinder.rpc [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 31 14:43:05 devstack cinder-volume[77526]: INFO cinder.rpc [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 31 14:43:05 devstack cinder-volume[77526]: DEBUG oslo_db.sqlalchemy.engines [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:43:05 devstack cinder-volume[77526]: INFO cinder.volume.manager [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Determined volume DB was empty at startup.
Jul 31 14:43:05 devstack cinder-volume[77526]: DEBUG cinder.volume.manager [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77526) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 31 14:43:05 devstack cinder-volume[77526]: INFO cinder.volume.manager [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 31 14:43:05 devstack cinder-volume[77526]: WARNING stevedore.named [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 31 14:43:05 devstack cinder-volume[77526]: WARNING castellan.key_manager [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 31 14:43:05 devstack cinder-volume[77526]: WARNING cinder.keymgr.conf_key_mgr [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 31 14:43:05 devstack cinder-volume[77526]: DEBUG cinder.volume.drivers.lvm [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77526) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Jul 31 14:43:05 devstack cinder-volume[77526]: DEBUG oslo_concurrency.processutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_concurrency.processutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.465s {{(pid=77526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_db.sqlalchemy.engines [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:43:06 devstack cinder-volume[77526]: INFO cinder.rpc [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 31 14:43:06 devstack cinder-volume[77526]: INFO cinder.rpc [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 31 14:43:06 devstack cinder-volume[77526]: WARNING stevedore.named [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 31 14:43:06 devstack cinder-volume[77526]: WARNING castellan.key_manager [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 31 14:43:06 devstack cinder-volume[77526]: INFO cinder.volume.manager [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_db.sqlalchemy.engines [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:43:06 devstack cinder-volume[77526]: INFO oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Starting 1 workers
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Started child 77684 {{(pid=77526) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Full set of CONF: {{(pid=77526) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] ******************************************************************************** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Configuration options gathered from: {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] ================================================================================ {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] allow_availability_zone_fallback = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] allow_compression_on_image_upload = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] allowed_direct_url_schemes     = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] api_rate_limit                 = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] auth_strategy                  = keystone {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] az_cache_duration              = 3600 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_availability_zone      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_host                   = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_name                   = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_stats_polling_interval = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backup_api_class               = cinder.backup.api.API {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backup_name_template           = backup-%s {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backup_use_same_host           = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backup_use_temp_snapshot       = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] chap_password                  = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] chap_username                  =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_internal_tenant_project_id = 43cab6170ac04238b82f9a1ff727f713 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_internal_tenant_user_id = e049d05cdab14ded8c2ac4c5d8f25907 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cloned_volume_same_az          = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cluster                        = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] compression_format             = gzip {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] compute_api_class              = cinder.compute.nova.API {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] config_dir                     = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] config_source                  = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] control_exchange               = openstack {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] debug                          = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] default_availability_zone      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] default_group_type             = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] default_volume_type            = lvmdriver-1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] disk_geometry                  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] driver_client_cert             = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] driver_client_cert_key         = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] driver_data_namespace          = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] driver_ssl_cert_path           = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] driver_ssl_cert_verify         = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] driver_use_ssl                 = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] enable_force_upload            = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] enable_new_services            = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] enable_unsupported_driver      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] enforce_multipath_for_image_xfer = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] filter_function                = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_api_insecure            = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_api_ssl_compression     = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_ca_certificates_file    = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_catalog_info            = image:glance:publicURL {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_certfile                = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_keyfile                 = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_num_retries             = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance_request_timeout         = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] goodness_function              = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] graceful_shutdown_timeout      = 5 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] group_api_class                = cinder.group.api.API {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] host                           = devstack {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_compress_on_upload       = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_conversion_address_space_limit = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_conversion_cpu_limit     = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_conversion_disable       = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_upload_use_cinder_backend = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_upload_use_internal_tenant = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_volume_cache_enabled     = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_volume_cache_max_count   = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77684]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] init_host_max_objects_retrieval = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] iscsi_target_flags             =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] iscsi_write_cache              = on {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] iser_helper                    = tgtadm {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] iser_ip_address                = 192.168.122.132 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] iser_port                      = 3260 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_color                      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_config_append              = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_dir                        = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_file                       = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_options                    = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_rotate_interval            = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_rotate_interval_type       = days {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] log_rotation_type              = none {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] max_age                        = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] max_logfile_count              = 30 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] max_logfile_size_mb            = 200 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] max_over_subscription_ratio    = 20.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] message_reap_interval          = 86400 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] message_ttl                    = 2592000 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] monkey_patch                   = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] monkey_patch_modules           = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] my_ip                          = 192.168.122.132 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] no_snapshot_gb_quota           = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] num_iser_scan_tries            = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] num_shell_tries                = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] num_volume_device_scan_tries   = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] nvmeof_conn_info_version       = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] nvmet_ns_id                    = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] nvmet_port_id                  = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] osapi_max_limit                = 1000 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] osapi_volume_ext_list          = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] osapi_volume_listen_port       = 8776 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] osapi_volume_use_ssl           = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] osapi_volume_workers           = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] per_volume_size_limit          = -1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] periodic_fuzzy_delay           = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] periodic_interval              = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] public_endpoint                = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] publish_errors                 = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] quota_backup_gigabytes         = 1000 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] quota_backups                  = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] quota_gigabytes                = 1000 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] quota_groups                   = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] quota_snapshots                = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77684]: INFO cinder.volume.manager [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] quota_volumes                  = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] rate_limit_burst               = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] rate_limit_except_level        = CRITICAL {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] rate_limit_interval            = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] reinit_driver_count            = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] replication_device             = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] report_discard_supported       = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] report_interval                = 120 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] reservation_clean_interval     = 86400 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] reservation_expire             = 86400 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] reserved_image_namespaces      = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] reserved_percentage            = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] rpc_response_timeout           = 120 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] run_external_periodic_tasks    = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] scst_target_driver             = iscsi {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] scst_target_iqn_name           = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_down_time              = 720 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] shell_completion               = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] snapshot_name_template         = snapshot-%s {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] snapshot_same_host             = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] split_loggers                  = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] state_path                     = /opt/stack/data/cinder {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] storage_availability_zone      = nova {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] storage_protocol               = iSCSI {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] syslog_log_facility            = LOG_USER {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] target_helper                  = lioadm {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] target_ip_address              = 192.168.122.132 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] target_port                    = 3260 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] target_protocol                = iscsi {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] target_secondary_ip_addresses  = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] trace_flags                    = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] transport_url                  = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] until_refresh                  = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] use_chap_auth                  = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] use_default_quota_class        = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] use_journal                    = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] use_json                       = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] use_multipath_for_image_xfer   = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] use_stderr                     = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] use_syslog                     = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] verify_glance_signatures       = enabled {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_api_class               = cinder.volume.api.API {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_backend_name            = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_clear                   = zero {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_clear_ionice            = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_clear_size              = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_copy_bps_limit          = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_dd_blocksize            = 1M {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_name_template           = volume-%s {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_service_inithost_offload = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volume_usage_audit_period      = month {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] zoning_mode                    = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.auth_section = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.auth_type   = password {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.auth_version = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.cache       = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.certfile    = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.insecure    = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.interface   = public {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.keyfile     = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_password =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcache_username =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.region_name = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.service_type = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.backend                  = dogpile.cache.null {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.backend_argument         = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.backend_expiration_time  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.config_prefix            = cache.oslo {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.debug_cache_backend      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.enable_retry_client      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.enable_socket_keepalive  = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.enabled                  = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.expiration_time          = 600 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.memcache_dead_retry      = 300 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.memcache_sasl_enabled    = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.password                 = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.proxies                  = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.redis_db                 = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.redis_server             = localhost:6379 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.retry_attempts           = 2 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.retry_delay              = 0.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.socket_keepalive_count   = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.socket_keepalive_idle    = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.socket_keepalive_interval = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.socket_timeout           = 1.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.tls_allowed_ciphers      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.tls_cafile               = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.tls_certfile             = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.tls_enabled              = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.tls_keyfile              = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cache.username                 = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] coordination.backend_url       = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.asyncio_connection    = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.asyncio_slave_connection = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.backend               = sqlalchemy {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.connection            = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.connection_debug      = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.connection_parameters =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.connection_recycle_time = 3600 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.connection_trace      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.db_inc_retry_interval = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.db_max_retries        = 20 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.db_max_retry_interval = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.db_retry_interval     = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.max_overflow          = 50 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.max_pool_size         = 5 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.max_retries           = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.pool_timeout          = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.retry_interval        = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.slave_connection      = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.sqlite_synchronous    = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.synchronous_reader    = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] database.use_db_reconnect      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.connection_string     = messaging:// {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.enabled               = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.es_doc_type           = notification {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.es_scroll_size        = 10000 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.es_scroll_time        = 2m {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.filter_error_trace    = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.hmac_keys             = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.sentinel_service_name = mymaster {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.socket_timeout        = 0.1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.trace_requests        = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler.trace_sqlalchemy      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler_jaeger.process_tags   = {} {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] profiler_otlp.service_name_prefix = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.policy_default_rule = default {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] privsep_osbrick.group          = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] privsep_osbrick.helper_command = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] privsep_osbrick.user           = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_sys_admin.group         = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_sys_admin.helper_command = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] cinder_sys_admin.user          = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.auth_section      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.auth_type         = password {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.cafile            = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.certfile          = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.collect_timing    = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.insecure          = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.keyfile           = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.send_service_user_token = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.split_loggers     = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] service_user.timeout           = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.auth_section            = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.auth_type               = password {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.certfile                = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.collect_timing          = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.insecure                = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.keyfile                 = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.region_name             = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.split_loggers           = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] glance.timeout                 = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.backend_availability_zone = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.chap_password = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.chap_username =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.disk_geometry = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.driver_client_cert = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.driver_data_namespace = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:06 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.driver_use_ssl = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.extra_capabilities = {} {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.filter_function = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.goodness_function = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.iscsi_target_flags =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.iser_helper   = tgtadm {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.iser_port     = 3260 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.lvm_share_target = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.lvm_type      = auto {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.replication_device = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.report_discard_supported = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.target_helper = tgtadm {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.target_port   = 3260 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.target_protocol = iscsi {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.trace_flags   = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.use_chap_auth = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_backend_name = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_clear  = zero {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_reports.file_event_handler = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_reports.log_dir           = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.backend_host       = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.chap_password      = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.chap_username      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.disk_geometry      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.driver_client_cert = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.extra_capabilities = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.filter_function    = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.goodness_function  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.iser_helper        = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.iser_ip_address    = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.iser_port          = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.lvm_share_target   = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.lvm_type           = auto {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.num_shell_tries    = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.replication_device = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.report_discard_supported = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.reserved_percentage = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.scst_target_driver = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.storage_protocol   = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.target_helper      = lioadm {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.target_ip_address  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.target_port        = 3260 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.trace_flags        = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.use_chap_auth      = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_clear       = zero {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_clear_size  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] lvmdriver-1.volumes_dir        = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack sudo[77690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack sudo[77690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_notifications.driver = [] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] key_manager.fixed_key          = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.barbican_api_version  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.barbican_endpoint     = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.barbican_endpoint_type = public {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.barbican_region_name  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.cafile                = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.certfile              = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.collect_timing        = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.insecure              = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.keyfile               = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.number_of_retries     = 60 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.retry_delay           = 1 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.send_service_user_token = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.split_loggers         = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.timeout               = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.verify_ssl            = True {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican.verify_ssl_path       = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.auth_section = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.auth_type = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.cafile   = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.certfile = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.collect_timing = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.insecure = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.keyfile  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.split_loggers = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] barbican_service_user.timeout  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.approle_role_id          = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.approle_secret_id        = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.auth_method              = approle {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.auth_path                = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.kv_mountpoint            = secret {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.kv_path                  = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.kv_version               = 2 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.namespace                = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.root_token_id            = **** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.ssl_ca_crt_file          = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.timeout                  = 60.0 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.token_file               = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.token_role               = None {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.use_ssl                  = False {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:43:06 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] ******************************************************************************** {{(pid=77526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 31 14:43:07 devstack sudo[77690]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:07 devstack sudo[77807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:07 devstack sudo[77807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:07 devstack sudo[77807]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.284s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 14:43:07 devstack cinder-volume[77684]: INFO cinder.brick.local_dev.lvm [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:07 devstack sudo[77921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:43:07 devstack sudo[77921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:07 devstack sudo[77921]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG cinder.brick.local_dev.lvm [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77684) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Jul 31 14:43:07 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:07 devstack sudo[78006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:07 devstack sudo[78006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:08 devstack sudo[78006]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:08 devstack sudo[78208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:08 devstack sudo[78208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:08 devstack sudo[78208]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:08 devstack sudo[78299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 31 14:43:08 devstack sudo[78299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:08 devstack sudo[78299]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.249s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:08 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:08 devstack sudo[78302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:43:08 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:09 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:09 devstack sudo[78386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:43:09 devstack sudo[78386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:09 devstack sudo[78386]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:09 devstack sudo[78389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:43:09 devstack sudo[78389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:09 devstack sudo[78389]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:09 devstack sudo[78478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:09 devstack sudo[78478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:09 devstack sudo[78478]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:09 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:09 devstack sudo[78482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:09 devstack sudo[78482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:10 devstack sudo[78482]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:10 devstack cinder-volume[77684]: INFO cinder.volume.drivers.lvm [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:10 devstack sudo[78486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:10 devstack sudo[78486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:10 devstack sudo[78486]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG cinder.volume.drivers.lvm [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Updating volume stats {{(pid=77684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:10 devstack sudo[78495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:43:10 devstack sudo[78495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:10 devstack sudo[78495]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:10 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:10 devstack sudo[78498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:43:10 devstack sudo[78498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:11 devstack sudo[78498]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:11 devstack sudo[78501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:11 devstack sudo[78501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:11 devstack sudo[78501]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:11 devstack sudo[78505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:43:11 devstack sudo[78505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:11 devstack sudo[78505]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:11 devstack cinder-volume[77684]: INFO cinder.volume.driver [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Driver hasn't implemented _init_vendor_properties()
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG cinder.volume.driver [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77684) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_db.sqlalchemy.engines [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77684) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG dbcounter [-] [77684] Writer thread running {{(pid=77684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG cinder.db.api [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Building query based on filter {{(pid=77684) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG cinder.image.image_utils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77684) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 31 14:43:11 devstack cinder-volume[77684]: INFO cinder.keymgr.migration [None req-6bdbf280-1003-402a-bd8c-0ea2a7f4029d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG cinder.volume.drivers.lvm [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Updating volume stats {{(pid=77684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:11 devstack sudo[78508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:43:11 devstack sudo[78508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:11 devstack sudo[78508]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:11 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:12 devstack sudo[78513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:43:12 devstack sudo[78513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:12 devstack sudo[78513]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:12 devstack sudo[78517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:12 devstack sudo[78517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:12 devstack sudo[78517]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:12 devstack sudo[78520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:43:12 devstack sudo[78520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:12 devstack sudo[78520]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG cinder.manager [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Notifying Schedulers of capabilities ... {{(pid=77684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:43:12 devstack cinder-volume[77684]: INFO cinder.volume.manager [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Driver initialization completed successfully.
Jul 31 14:43:12 devstack cinder-volume[77684]: INFO cinder.manager [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Initiating service 2 cleanup
Jul 31 14:43:12 devstack cinder-volume[77684]: INFO cinder.manager [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Service 2 cleanup completed.
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG cinder.service [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Creating RPC server for service cinder-volume {{(pid=77684) start /opt/stack/cinder/cinder/service.py:231}}
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG cinder.service [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77684) start /opt/stack/cinder/cinder/service.py:237}}
Jul 31 14:43:12 devstack cinder-volume[77684]: INFO cinder.volume.manager [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG cinder.volume.drivers.lvm [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Updating volume stats {{(pid=77684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 31 14:43:12 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:12 devstack sudo[78525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:43:12 devstack sudo[78525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:13 devstack sudo[78525]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:13 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:13 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:13 devstack sudo[78528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:43:13 devstack sudo[78528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:13 devstack sudo[78528]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:13 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:13 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:13 devstack sudo[78531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:43:13 devstack sudo[78531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:13 devstack sudo[78531]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:13 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:13 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:43:13 devstack sudo[78537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:43:13 devstack sudo[78537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:43:14 devstack sudo[78537]: pam_unix(sudo:session): session closed for user root
Jul 31 14:43:14 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:43:14 devstack cinder-volume[77684]: INFO cinder.volume.manager [None req-82f2e0ff-3869-4188-b5d3-468dbc492174 None None] Driver post RPC initialization completed successfully.
Jul 31 14:43:16 devstack cinder-volume[77526]: DEBUG dbcounter [-] [77526] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:43:24 devstack cinder-volume[77684]: DEBUG dbcounter [-] [77684] Writing DB stats cinder:SELECT=3 {{(pid=77684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:43:24 devstack cinder-volume[77684]: DEBUG dbcounter [-] [77684] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:43:24 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager._thread_info {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:43:24 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread count: 6 {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:43:24 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread info: [<_MainThread(MainThread, started 127978485076096)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127978375201024)>, <Thread(Thread-3 (stat_writer), started daemon 127978372023040)>, <Thread(Rabbit-heartbeat, started daemon 127978370805696)>, <Thread(Thread-5 (_runner), started daemon 127978370906368)>, <Thread(Thread-7 (_runner), started daemon 127978370950912)>] {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG cinder.volume.drivers.lvm [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Updating volume stats {{(pid=77684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:44:24 devstack sudo[80780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:44:24 devstack sudo[80780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:44:24 devstack sudo[80780]: pam_unix(sudo:session): session closed for user root
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:44:24 devstack sudo[80783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:44:24 devstack sudo[80783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:44:24 devstack sudo[80783]: pam_unix(sudo:session): session closed for user root
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:44:24 devstack sudo[80873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:44:24 devstack sudo[80873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:44:24 devstack sudo[80873]: pam_unix(sudo:session): session closed for user root
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:44:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:44:24 devstack sudo[80899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:44:24 devstack sudo[80899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:44:25 devstack sudo[80899]: pam_unix(sudo:session): session closed for user root
Jul 31 14:44:25 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:44:25 devstack cinder-volume[77684]: DEBUG cinder.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Notifying Schedulers of capabilities ... {{(pid=77684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:44:25 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager._thread_info {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:44:25 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread count: 6 {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:44:25 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread info: [<_MainThread(MainThread, started 127978485076096)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127978375201024)>, <Thread(Thread-3 (stat_writer), started daemon 127978372023040)>, <Thread(Rabbit-heartbeat, started daemon 127978370805696)>, <Thread(Thread-5 (_runner), started daemon 127978370906368)>, <Thread(Thread-7 (_runner), started daemon 127978370950912)>] {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG dbcounter [-] [77684] Writing DB stats cinder:SELECT=1 {{(pid=77684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG dbcounter [-] [77684] Writing DB stats cinder:UPDATE=1 {{(pid=77684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG cinder.volume.drivers.lvm [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Updating volume stats {{(pid=77684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:45:24 devstack sudo[84086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:45:24 devstack sudo[84086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:45:24 devstack sudo[84086]: pam_unix(sudo:session): session closed for user root
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:45:24 devstack sudo[84091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:45:24 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:45:24 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:45:24 devstack sudo[84094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:45:24 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:45:24 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:45:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:45:24 devstack sudo[84097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:45:24 devstack sudo[84097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:45:25 devstack sudo[84097]: pam_unix(sudo:session): session closed for user root
Jul 31 14:45:25 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:45:25 devstack cinder-volume[77684]: DEBUG cinder.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Notifying Schedulers of capabilities ... {{(pid=77684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:45:25 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager._thread_info {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:45:25 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread count: 6 {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:45:25 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread info: [<_MainThread(MainThread, started 127978485076096)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127978375201024)>, <Thread(Thread-3 (stat_writer), started daemon 127978372023040)>, <Thread(Rabbit-heartbeat, started daemon 127978370805696)>, <Thread(Thread-5 (_runner), started daemon 127978370906368)>, <Thread(Thread-7 (_runner), started daemon 127978370950912)>] {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG cinder.volume.drivers.lvm [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Updating volume stats {{(pid=77684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:46:24 devstack sudo[86120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:46:24 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:46:24 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:46:24 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:46:24 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:46:24 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:46:24 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:46:24 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:46:24 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:46:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:46:24 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:46:24 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:46:25 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Jul 31 14:46:25 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:46:25 devstack cinder-volume[77684]: DEBUG cinder.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Notifying Schedulers of capabilities ... {{(pid=77684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG dbcounter [-] [77684] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG cinder.volume.drivers.lvm [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Updating volume stats {{(pid=77684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:24 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 31 14:47:24 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:24 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:24 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:47:24 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:24 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:24 devstack sudo[87408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 31 14:47:24 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:24 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:24 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:24 devstack sudo[87412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 31 14:47:24 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:25 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:25 devstack cinder-volume[77684]: DEBUG oslo_concurrency.processutils [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:25 devstack cinder-volume[77684]: DEBUG cinder.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Notifying Schedulers of capabilities ... {{(pid=77684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:47:25 devstack cinder-volume[77684]: DEBUG oslo_service.periodic_task [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] Running periodic task VolumeManager._thread_info {{(pid=77684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:47:25 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread count: 6 {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:47:25 devstack cinder-volume[77684]: DEBUG cinder.volume.manager [None req-8ae7a1b7-856b-4b3c-bcdc-bc27f9071a30 None None] thread info: [<_MainThread(MainThread, started 127978485076096)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127978375201024)>, <Thread(Thread-3 (stat_writer), started daemon 127978372023040)>, <Thread(Rabbit-heartbeat, started daemon 127978370805696)>, <Thread(Thread-5 (_runner), started daemon 127978370906368)>, <Thread(Thread-7 (_runner), started daemon 127978370950912)>] {{(pid=77684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:47:36 devstack cinder-volume[77526]: INFO oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Caught SIGTERM, stopping children
Jul 31 14:47:36 devstack cinder-volume[77526]: DEBUG oslo_concurrency.lockutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Acquiring lock "singleton_lock" {{(pid=77526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 31 14:47:36 devstack cinder-volume[77526]: DEBUG oslo_concurrency.lockutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Acquired lock "singleton_lock" {{(pid=77526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 31 14:47:36 devstack cinder-volume[77526]: DEBUG oslo_concurrency.lockutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Releasing lock "singleton_lock" {{(pid=77526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 31 14:47:36 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Stop services. {{(pid=77526) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 31 14:47:36 devstack cinder-volume[77526]: DEBUG oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Killing children. {{(pid=77526) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 31 14:47:36 devstack cinder-volume[77526]: INFO oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Waiting on 1 children to exit
Jul 31 14:47:37 devstack cinder-volume[77684]: DEBUG oslo_concurrency.lockutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Acquiring lock "singleton_lock" {{(pid=77684) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 31 14:47:37 devstack cinder-volume[77684]: DEBUG oslo_concurrency.lockutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Acquired lock "singleton_lock" {{(pid=77684) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 31 14:47:37 devstack cinder-volume[77684]: DEBUG oslo_concurrency.lockutils [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Releasing lock "singleton_lock" {{(pid=77684) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 31 14:47:37 devstack cinder-volume[77684]: WARNING amqp [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 31 14:47:37 devstack cinder-volume[77684]: WARNING amqp [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 31 14:47:37 devstack cinder-volume[77526]: INFO oslo_service.backend._eventlet.service [None req-46410d4d-ba5f-43dd-bd53-2dd42de8f8a7 None None] Child 77684 exited with status 0
Jul 31 14:47:38 devstack cinder-volume[87797]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 31 14:47:38 devstack cinder-volume[87797]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 31 14:47:38 devstack cinder-volume[87797]: we strongly recommend against using it for new projects.
Jul 31 14:47:38 devstack cinder-volume[87797]: If you are already using Eventlet, we recommend migrating to a different
Jul 31 14:47:38 devstack cinder-volume[87797]: framework.  For more detail see
Jul 31 14:47:38 devstack cinder-volume[87797]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 31 14:47:38 devstack cinder-volume[87797]:   import eventlet  # noqa
Jul 31 14:47:40 devstack cinder-volume[87797]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 31 14:47:40 devstack cinder-volume[87797]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 31 14:47:40 devstack cinder-volume[87797]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 31 14:47:41 devstack cinder-volume[87797]: INFO dbcounter [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Registered counter for database cinder
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_db.sqlalchemy.engines [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG dbcounter [-] [87797] Writer thread running {{(pid=87797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 31 14:47:41 devstack cinder-volume[87797]: INFO cinder.rpc [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 31 14:47:41 devstack cinder-volume[87797]: INFO cinder.rpc [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_db.sqlalchemy.engines [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:41 devstack cinder-volume[87797]: INFO cinder.volume.manager [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Determined volume DB was empty at startup.
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG cinder.volume.manager [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87797) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 31 14:47:41 devstack cinder-volume[87797]: INFO cinder.volume.manager [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 31 14:47:41 devstack cinder-volume[87797]: WARNING stevedore.named [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 31 14:47:41 devstack cinder-volume[87797]: WARNING castellan.key_manager [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 31 14:47:41 devstack cinder-volume[87797]: WARNING cinder.keymgr.conf_key_mgr [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 31 14:47:41 devstack cinder-volume[87797]: INFO cinder.volume.manager [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_db.sqlalchemy.engines [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:41 devstack cinder-volume[87797]: INFO oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Starting 1 workers
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Started child 88014 {{(pid=87797) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Full set of CONF: {{(pid=87797) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] ******************************************************************************** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Configuration options gathered from: {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] ================================================================================ {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 31 14:47:41 devstack cinder-volume[88014]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] allow_availability_zone_fallback = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] allow_compression_on_image_upload = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] allowed_direct_url_schemes     = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] api_rate_limit                 = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] auth_strategy                  = keystone {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_availability_zone      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_host                   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_name                   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_stats_polling_interval = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backup_api_class               = cinder.backup.api.API {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backup_name_template           = backup-%s {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backup_use_same_host           = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backup_use_temp_snapshot       = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] chap_password                  = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] chap_username                  =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_internal_tenant_project_id = 43cab6170ac04238b82f9a1ff727f713 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_internal_tenant_user_id = e049d05cdab14ded8c2ac4c5d8f25907 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cluster                        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] compression_format             = gzip {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] config_dir                     = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] config_source                  = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] control_exchange               = openstack {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] debug                          = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] default_availability_zone      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] default_group_type             = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] default_volume_type            = QuobyteHD {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] disk_geometry                  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] driver_client_cert             = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] driver_client_cert_key         = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] driver_data_namespace          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] driver_ssl_cert_path           = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] driver_ssl_cert_verify         = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[88014]: INFO cinder.volume.manager [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Starting volume driver QuobyteDriver (1.2)
Jul 31 14:47:41 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.remotefs [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88014) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] driver_use_ssl                 = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] enable_new_services            = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] enable_unsupported_driver      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] enforce_multipath_for_image_xfer = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] filter_function                = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_api_insecure            = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_api_ssl_compression     = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_ca_certificates_file    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_certfile                = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_keyfile                 = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_num_retries             = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance_request_timeout         = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] goodness_function              = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] graceful_shutdown_timeout      = 5 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] group_api_class                = cinder.group.api.API {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] host                           = devstack {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_compress_on_upload       = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_conversion_address_space_limit = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_conversion_cpu_limit     = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_conversion_disable       = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_upload_use_cinder_backend = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_upload_use_internal_tenant = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_volume_cache_enabled     = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_volume_cache_max_count   = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] image_volume_cache_max_size_gb = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] init_host_max_objects_retrieval = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] iscsi_target_flags             =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] iscsi_write_cache              = on {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] iser_helper                    = tgtadm {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] iser_ip_address                = 192.168.122.132 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] iser_port                      = 3260 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_color                      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_config_append              = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_dir                        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_file                       = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_options                    = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_rotate_interval            = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_rotate_interval_type       = days {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] log_rotation_type              = none {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] max_age                        = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] max_logfile_count              = 30 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] max_logfile_size_mb            = 200 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] max_over_subscription_ratio    = 20.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] message_reap_interval          = 86400 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] message_ttl                    = 2592000 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] migration_create_volume_timeout_secs = 300 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] monkey_patch                   = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] monkey_patch_modules           = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] my_ip                          = 192.168.122.132 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] no_snapshot_gb_quota           = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] num_iser_scan_tries            = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] num_shell_tries                = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] num_volume_device_scan_tries   = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] nvmeof_conn_info_version       = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] nvmet_ns_id                    = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] nvmet_port_id                  = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] osapi_max_limit                = 1000 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] osapi_volume_ext_list          = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:41 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] osapi_volume_listen_port       = 8776 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] osapi_volume_use_ssl           = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] osapi_volume_workers           = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] per_volume_size_limit          = -1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] periodic_fuzzy_delay           = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] periodic_interval              = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] public_endpoint                = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] publish_errors                 = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] quota_backup_gigabytes         = 1000 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] quota_backups                  = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88014) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] quota_gigabytes                = 1000 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[88014]: WARNING cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] quota_groups                   = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[88014]: WARNING cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] quota_snapshots                = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Running cmd (subprocess): mount.quobyte {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] quota_volumes                  = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] rate_limit_burst               = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] rate_limit_except_level        = CRITICAL {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] rate_limit_interval            = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] reinit_driver_count            = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] replication_device             = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] report_discard_supported       = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] report_interval                = 120 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] reservation_clean_interval     = 86400 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] reservation_expire             = 86400 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] reserved_image_namespaces      = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] reserved_percentage            = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] rpc_response_timeout           = 120 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] run_external_periodic_tasks    = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] scst_target_driver             = iscsi {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] scst_target_iqn_name           = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_down_time              = 720 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] shell_completion               = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] snapshot_name_template         = snapshot-%s {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] split_loggers                  = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] state_path                     = /opt/stack/data/cinder {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] storage_availability_zone      = nova {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] storage_protocol               = iSCSI {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] syslog_log_facility            = LOG_USER {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] target_helper                  = lioadm {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] target_ip_address              = 192.168.122.132 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] target_port                    = 3260 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] target_protocol                = iscsi {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] target_secondary_ip_addresses  = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] trace_flags                    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] transport_url                  = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] until_refresh                  = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] use_chap_auth                  = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] use_default_quota_class        = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] use_journal                    = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] use_json                       = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] use_multipath_for_image_xfer   = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] use_stderr                     = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] use_syslog                     = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] verify_glance_signatures       = enabled {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_api_class               = cinder.volume.api.API {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_backend_name            = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_clear                   = zero {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_clear_ionice            = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_clear_size              = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_copy_bps_limit          = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_dd_blocksize            = 1M {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_name_template           = volume-%s {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_service_inithost_offload = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volume_usage_audit_period      = month {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] zoning_mode                    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_concurrency.disable_process_locking = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.auth_section = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.auth_type   = password {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.auth_version = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.cache       = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.certfile    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.include_service_catalog = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.insecure    = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.interface   = public {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.keyfile     = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_password =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcache_username =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.region_name = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.service_type = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.backend                  = dogpile.cache.null {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.backend_argument         = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.backend_expiration_time  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.config_prefix            = cache.oslo {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.debug_cache_backend      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.enable_retry_client      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.enable_socket_keepalive  = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.enabled                  = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.expiration_time          = 600 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.hashclient_retry_attempts = 2 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[88014]: INFO cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f ...
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.memcache_dead_retry      = 300 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 -c /etc/quobyte/client-cinder.cfg {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.memcache_sasl_enabled    = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.password                 = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.proxies                  = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.redis_db                 = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.redis_server             = localhost:6379 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.retry_attempts           = 2 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.retry_delay              = 0.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.socket_keepalive_count   = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.socket_keepalive_idle    = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.socket_keepalive_interval = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.socket_timeout           = 1.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.tls_allowed_ciphers      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.tls_cafile               = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.tls_certfile             = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.tls_enabled              = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.tls_keyfile              = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cache.username                 = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] coordination.backend_url       = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.asyncio_connection    = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.asyncio_slave_connection = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.backend               = sqlalchemy {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.connection            = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.connection_debug      = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.connection_parameters =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.connection_recycle_time = 3600 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.connection_trace      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.db_inc_retry_interval = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.db_max_retries        = 20 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.db_max_retry_interval = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.db_retry_interval     = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.max_overflow          = 50 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.max_pool_size         = 5 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.max_retries           = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 -c /etc/quobyte/client-cinder.cfg
Jul 31 14:47:42 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.mysql_wsrep_sync_wait = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.pool_timeout          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.retry_interval        = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.slave_connection      = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.sqlite_synchronous    = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.synchronous_reader    = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] database.use_db_reconnect      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.connection_string     = messaging:// {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.enabled               = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.es_doc_type           = notification {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.es_scroll_size        = 10000 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.es_scroll_time        = 2m {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.filter_error_trace    = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.hmac_keys             = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.sentinel_service_name = mymaster {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.socket_timeout        = 0.1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.trace_requests        = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler.trace_sqlalchemy      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler_jaeger.process_tags   = {} {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler_jaeger.service_name_prefix = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] profiler_otlp.service_name_prefix = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.enforce_new_defaults = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.policy_default_rule = default {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] privsep_osbrick.group          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] privsep_osbrick.helper_command = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] privsep_osbrick.user           = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_sys_admin.group         = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_sys_admin.helper_command = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] cinder_sys_admin.user          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.auth_section      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.auth_type         = password {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.cafile            = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.certfile          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.collect_timing    = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.insecure          = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.keyfile           = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.send_service_user_token = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.split_loggers     = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] service_user.timeout           = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.auth_section            = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.auth_type               = password {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.certfile                = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.collect_timing          = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.insecure                = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.keyfile                 = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.region_name             = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.split_loggers           = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] glance.timeout                 = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.backend_availability_zone = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.chap_password = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.chap_username =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.disk_geometry = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.driver_client_cert = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.driver_client_cert_key = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.driver_data_namespace = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.driver_use_ssl = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.extra_capabilities = {} {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.filter_function = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.goodness_function = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.iscsi_target_flags =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.iscsi_write_cache = on {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.iser_port     = 3260 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_host      =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_login     = admin {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_mount_options = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_password  = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_private_key =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_share_path =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.num_shell_tries = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.quobyte_volume_url = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.replication_device = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.report_discard_supported = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.reserved_percentage = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.target_helper = tgtadm {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.target_port   = 3260 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.target_protocol = iscsi {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.trace_flags   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.unique_fqdn_network = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.use_chap_auth = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_backend_name = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_clear  = zero {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_clear_ionice = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_clear_size = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_reports.file_event_handler = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_reports.log_dir           = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.backend_availability_zone = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.backend_host         = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.chap_password        = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.chap_username        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.disk_geometry        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.driver_client_cert   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.driver_data_namespace = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.extra_capabilities   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.filter_function      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.goodness_function    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.iser_helper          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.iser_ip_address      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.iser_port            = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_host             = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_login            = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_mount_options    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_password         = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_private_key      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_share_path       = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.num_shell_tries      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.replication_device   = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.report_discard_supported = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.reserved_percentage  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.scst_target_driver   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.storage_protocol     = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.target_helper        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.target_ip_address    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.target_port          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.target_prefix        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.target_protocol      = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.trace_flags          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.use_chap_auth        = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_clear         = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_clear_size    = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] QuobyteHD.volumes_dir          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_notifications.driver = [] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_notifications.retry = -1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] key_manager.fixed_key          = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.barbican_api_version  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.barbican_endpoint     = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.barbican_endpoint_type = public {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.barbican_region_name  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.cafile                = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.certfile              = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.collect_timing        = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.insecure              = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.keyfile               = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.number_of_retries     = 60 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.retry_delay           = 1 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.send_service_user_token = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.split_loggers         = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.timeout               = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.verify_ssl            = True {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican.verify_ssl_path       = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.auth_section = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.auth_type = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.cafile   = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.certfile = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.collect_timing = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.insecure = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.keyfile  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.split_loggers = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] barbican_service_user.timeout  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.approle_role_id          = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.approle_secret_id        = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.auth_method              = approle {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.auth_path                = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.kv_mountpoint            = secret {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.kv_path                  = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.kv_version               = 2 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.namespace                = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.root_token_id            = **** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.ssl_ca_crt_file          = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.timeout                  = 60.0 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.token_file               = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.token_role               = None {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.use_ssl                  = False {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:42 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] ******************************************************************************** {{(pid=87797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 31 14:47:42 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.384s {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:42 devstack cinder-volume[88014]: INFO cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f succeeded
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.394s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:42 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:47:42 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:42 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.233s {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:42 devstack cinder-volume[88014]: INFO cinder.volume.driver [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Driver hasn't implemented _init_vendor_properties()
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.volume.driver [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7441101074219, 'free_capacity_gb': 1775.7441101074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88014) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88014) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG dbcounter [-] [88014] Writer thread running {{(pid=88014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.db.api [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Building query based on filter {{(pid=88014) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.image.image_utils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88014) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 31 14:47:42 devstack cinder-volume[88014]: INFO cinder.keymgr.migration [None req-d9778762-c48c-4637-9c83-7cb6c86fbba1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:47:42 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:42 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:47:42 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:43 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.236s {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG cinder.manager [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Notifying Schedulers of capabilities ... {{(pid=88014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:47:43 devstack cinder-volume[88014]: INFO cinder.volume.manager [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Driver initialization completed successfully.
Jul 31 14:47:43 devstack cinder-volume[88014]: INFO cinder.manager [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Initiating service 3 cleanup
Jul 31 14:47:43 devstack cinder-volume[88014]: INFO cinder.manager [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Service 3 cleanup completed.
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG cinder.service [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Creating RPC server for service cinder-volume {{(pid=88014) start /opt/stack/cinder/cinder/service.py:231}}
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG cinder.service [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88014) start /opt/stack/cinder/cinder/service.py:237}}
Jul 31 14:47:43 devstack cinder-volume[88014]: INFO cinder.volume.manager [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:43 devstack sudo[88096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:47:43 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:43 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:43 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.252s {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:43 devstack cinder-volume[88014]: INFO cinder.volume.manager [None req-d7e4ae02-14f1-4d50-b3a9-d84b2b5377f8 None None] Driver post RPC initialization completed successfully.
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG cinder.volume.drivers.quobyte [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:48 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:47:48 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:48 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG oslo_concurrency.processutils [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.237s {{(pid=88014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:48 devstack cinder-volume[88014]: DEBUG cinder.manager [None req-0cf2ebe2-b773-459b-9485-afd6e149bf34 None None] Notifying Schedulers of capabilities ... {{(pid=88014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:47:48 devstack cinder-volume[87797]: INFO oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Caught SIGTERM, stopping children
Jul 31 14:47:48 devstack cinder-volume[87797]: DEBUG oslo_concurrency.lockutils [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Acquiring lock "singleton_lock" {{(pid=87797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 31 14:47:48 devstack cinder-volume[87797]: DEBUG oslo_concurrency.lockutils [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Acquired lock "singleton_lock" {{(pid=87797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 31 14:47:48 devstack cinder-volume[87797]: DEBUG oslo_concurrency.lockutils [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Releasing lock "singleton_lock" {{(pid=87797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 31 14:47:48 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Stop services. {{(pid=87797) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 31 14:47:48 devstack cinder-volume[87797]: DEBUG oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Killing children. {{(pid=87797) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 31 14:47:48 devstack cinder-volume[87797]: INFO oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Waiting on 1 children to exit
Jul 31 14:47:51 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Acquiring lock "singleton_lock" {{(pid=88014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 31 14:47:51 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Acquired lock "singleton_lock" {{(pid=88014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 31 14:47:51 devstack cinder-volume[88014]: DEBUG oslo_concurrency.lockutils [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Releasing lock "singleton_lock" {{(pid=88014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 31 14:47:51 devstack cinder-volume[88014]: WARNING amqp [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 31 14:47:51 devstack cinder-volume[88014]: WARNING amqp [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 31 14:47:51 devstack cinder-volume[87797]: INFO oslo_service.backend._eventlet.service [None req-1d7c828d-a616-422d-91f8-3e9aab76f5b6 None None] Child 88014 exited with status 0
Jul 31 14:47:52 devstack cinder-volume[88296]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 31 14:47:52 devstack cinder-volume[88296]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 31 14:47:52 devstack cinder-volume[88296]: we strongly recommend against using it for new projects.
Jul 31 14:47:52 devstack cinder-volume[88296]: If you are already using Eventlet, we recommend migrating to a different
Jul 31 14:47:52 devstack cinder-volume[88296]: framework.  For more detail see
Jul 31 14:47:52 devstack cinder-volume[88296]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 31 14:47:52 devstack cinder-volume[88296]:   import eventlet  # noqa
Jul 31 14:47:55 devstack cinder-volume[88296]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 31 14:47:55 devstack cinder-volume[88296]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 31 14:47:55 devstack cinder-volume[88296]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 31 14:47:55 devstack cinder-volume[88296]: INFO dbcounter [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Registered counter for database cinder
Jul 31 14:47:55 devstack cinder-volume[88296]: DEBUG oslo_db.sqlalchemy.engines [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG dbcounter [-] [88296] Writer thread running {{(pid=88296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 31 14:47:56 devstack cinder-volume[88296]: INFO cinder.rpc [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 31 14:47:56 devstack cinder-volume[88296]: INFO cinder.rpc [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_db.sqlalchemy.engines [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:56 devstack cinder-volume[88296]: INFO cinder.volume.manager [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Determined volume DB was empty at startup.
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG cinder.volume.manager [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88296) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 31 14:47:56 devstack cinder-volume[88296]: WARNING stevedore.named [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 31 14:47:56 devstack cinder-volume[88296]: WARNING castellan.key_manager [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 31 14:47:56 devstack cinder-volume[88296]: WARNING cinder.keymgr.conf_key_mgr [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 31 14:47:56 devstack cinder-volume[88296]: INFO cinder.volume.manager [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_db.sqlalchemy.engines [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:56 devstack cinder-volume[88296]: INFO oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Starting 1 workers
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Started child 88594 {{(pid=88296) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Full set of CONF: {{(pid=88296) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] ******************************************************************************** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] Configuration options gathered from: {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] ================================================================================ {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] allow_availability_zone_fallback = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] allow_compression_on_image_upload = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] allowed_direct_url_schemes     = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88594]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] api_rate_limit                 = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] auth_strategy                  = keystone {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_availability_zone      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_host                   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_name                   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_stats_polling_interval = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backup_api_class               = cinder.backup.api.API {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backup_name_template           = backup-%s {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backup_use_same_host           = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backup_use_temp_snapshot       = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] chap_password                  = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] chap_username                  =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_internal_tenant_project_id = 43cab6170ac04238b82f9a1ff727f713 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_internal_tenant_user_id = e049d05cdab14ded8c2ac4c5d8f25907 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cluster                        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] compression_format             = gzip {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] compute_api_class              = cinder.compute.nova.API {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] config_dir                     = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] config_source                  = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] control_exchange               = openstack {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] debug                          = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] default_availability_zone      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] default_group_type             = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] default_volume_type            = QuobyteHD {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] disk_geometry                  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] driver_client_cert             = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] driver_client_cert_key         = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] driver_data_namespace          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] driver_ssl_cert_path           = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] driver_ssl_cert_verify         = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] driver_use_ssl                 = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] enable_new_services            = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] enable_unsupported_driver      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] enabled_backends               = ['QuobyteHD'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] enforce_multipath_for_image_xfer = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] filter_function                = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_api_insecure            = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_api_ssl_compression     = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_ca_certificates_file    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_catalog_info            = image:glance:publicURL {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_certfile                = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_keyfile                 = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_num_retries             = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance_request_timeout         = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] goodness_function              = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] graceful_shutdown_timeout      = 5 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] group_api_class                = cinder.group.api.API {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] host                           = devstack {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_compress_on_upload       = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_conversion_address_space_limit = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_conversion_cpu_limit     = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_conversion_disable       = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_upload_use_cinder_backend = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_upload_use_internal_tenant = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_volume_cache_enabled     = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_volume_cache_max_count   = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] image_volume_cache_max_size_gb = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] init_host_max_objects_retrieval = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] instance_format                = [instance: %(uuid)s]  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] iscsi_target_flags             =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] iscsi_write_cache              = on {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] iser_helper                    = tgtadm {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] iser_ip_address                = 192.168.122.132 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] iser_port                      = 3260 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_color                      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_config_append              = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_dir                        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_file                       = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_options                    = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_rotate_interval            = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_rotate_interval_type       = days {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] log_rotation_type              = none {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Starting volume driver QuobyteDriver (1.2)
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] max_age                        = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] max_logfile_count              = 30 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] max_logfile_size_mb            = 200 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88594) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] max_over_subscription_ratio    = 20.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] message_reap_interval          = 86400 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] message_ttl                    = 2592000 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] migration_create_volume_timeout_secs = 300 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] monkey_patch                   = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] monkey_patch_modules           = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] my_ip                          = 192.168.122.132 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] no_snapshot_gb_quota           = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] num_iser_scan_tries            = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] num_shell_tries                = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] num_volume_device_scan_tries   = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] nvmeof_conn_info_version       = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] nvmet_ns_id                    = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] nvmet_port_id                  = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] osapi_max_limit                = 1000 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] osapi_volume_ext_list          = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] osapi_volume_listen_port       = 8776 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] osapi_volume_use_ssl           = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] osapi_volume_workers           = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] per_volume_size_limit          = -1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] periodic_fuzzy_delay           = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] periodic_interval              = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] public_endpoint                = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] publish_errors                 = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] quota_backup_gigabytes         = 1000 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] quota_backups                  = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] quota_gigabytes                = 1000 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] quota_groups                   = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] quota_snapshots                = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] quota_volumes                  = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] rate_limit_burst               = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] rate_limit_except_level        = CRITICAL {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] rate_limit_interval            = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] reinit_driver_count            = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] replication_device             = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] report_discard_supported       = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] report_interval                = 120 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] reservation_clean_interval     = 86400 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] reservation_expire             = 86400 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] reserved_image_namespaces      = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] reserved_percentage            = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] rpc_response_timeout           = 120 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] run_external_periodic_tasks    = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] scst_target_driver             = iscsi {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] scst_target_iqn_name           = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_down_time              = 720 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] shell_completion               = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] snapshot_name_template         = snapshot-%s {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] split_loggers                  = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] state_path                     = /opt/stack/data/cinder {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] storage_availability_zone      = nova {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] storage_protocol               = iSCSI {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] syslog_log_facility            = LOG_USER {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] target_helper                  = lioadm {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] target_ip_address              = 192.168.122.132 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] target_port                    = 3260 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] target_protocol                = iscsi {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] target_secondary_ip_addresses  = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] trace_flags                    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] transport_url                  = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] until_refresh                  = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] use_chap_auth                  = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] use_default_quota_class        = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] use_journal                    = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] use_json                       = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] use_multipath_for_image_xfer   = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] use_stderr                     = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] use_syslog                     = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] verify_glance_signatures       = enabled {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_api_class               = cinder.volume.api.API {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_backend_name            = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_clear                   = zero {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_clear_ionice            = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_clear_size              = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_copy_bps_limit          = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_dd_blocksize            = 1M {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_name_template           = volume-%s {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_service_inithost_offload = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volume_usage_audit_period      = month {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] zoning_mode                    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_concurrency.disable_process_locking = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.auth_section = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.auth_type   = password {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.auth_version = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.cache       = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.certfile    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.include_service_catalog = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.insecure    = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.interface   = public {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.keyfile     = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_password =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcache_username =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.region_name = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.service_type = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.backend                  = dogpile.cache.null {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.backend_argument         = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.backend_expiration_time  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.config_prefix            = cache.oslo {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.debug_cache_backend      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.enable_retry_client      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.enable_socket_keepalive  = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.enabled                  = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.expiration_time          = 600 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.hashclient_retry_attempts = 2 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.memcache_dead_retry      = 300 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.memcache_pool_maxsize    = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.memcache_sasl_enabled    = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.password                 = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.proxies                  = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.redis_db                 = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.redis_server             = localhost:6379 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.retry_attempts           = 2 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.retry_delay              = 0.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.socket_keepalive_count   = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.socket_keepalive_idle    = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.socket_keepalive_interval = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.socket_timeout           = 1.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.tls_allowed_ciphers      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.tls_cafile               = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.tls_certfile             = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.tls_enabled              = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.tls_keyfile              = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cache.username                 = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] coordination.backend_url       = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.asyncio_connection    = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.asyncio_slave_connection = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.backend               = sqlalchemy {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.connection            = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.connection_debug      = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.connection_parameters =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.connection_recycle_time = 3600 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.connection_trace      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.db_inc_retry_interval = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.db_max_retries        = 20 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.db_max_retry_interval = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.db_retry_interval     = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.max_overflow          = 50 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.max_pool_size         = 5 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.max_retries           = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.mysql_wsrep_sync_wait = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.pool_timeout          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.retry_interval        = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.slave_connection      = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.sqlite_synchronous    = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.synchronous_reader    = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] database.use_db_reconnect      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.connection_string     = messaging:// {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.enabled               = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.es_doc_type           = notification {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.es_scroll_size        = 10000 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.es_scroll_time        = 2m {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.filter_error_trace    = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.hmac_keys             = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.sentinel_service_name = mymaster {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.socket_timeout        = 0.1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.trace_requests        = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler.trace_sqlalchemy      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler_jaeger.process_tags   = {} {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler_jaeger.service_name_prefix = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] profiler_otlp.service_name_prefix = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.enforce_new_defaults = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.policy_default_rule = default {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.policy_file        = policy.yaml {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] privsep_osbrick.group          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] privsep_osbrick.helper_command = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] privsep_osbrick.user           = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_sys_admin.group         = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_sys_admin.helper_command = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] cinder_sys_admin.user          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.auth_section      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.auth_type         = password {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.cafile            = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.certfile          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.collect_timing    = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.insecure          = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.keyfile           = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.send_service_user_token = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.split_loggers     = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] service_user.timeout           = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.auth_section            = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.auth_type               = password {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.certfile                = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.collect_timing          = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.insecure                = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.keyfile                 = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.region_name             = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.split_loggers           = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] glance.timeout                 = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.backend_availability_zone = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.chap_password = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.chap_username =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.disk_geometry = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.driver_client_cert = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.driver_client_cert_key = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.driver_data_namespace = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.driver_use_ssl = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.extra_capabilities = {} {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.filter_function = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.goodness_function = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.iscsi_target_flags =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.iscsi_write_cache = on {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.iser_helper   = tgtadm {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.iser_port     = 3260 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_host      =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_login     = admin {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_mount_options = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_password  = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_private_key =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_share_path =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.num_shell_tries = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.quobyte_volume_url = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.replication_device = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.report_discard_supported = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.reserved_percentage = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88594) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 31 14:47:56 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.target_helper = tgtadm {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.target_port   = 3260 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.target_protocol = iscsi {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.trace_flags   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.unique_fqdn_network = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.use_chap_auth = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_backend_name = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_clear  = zero {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_clear_ionice = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_clear_size = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_reports.file_event_handler = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_reports.log_dir           = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.backend_availability_zone = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Running cmd (subprocess): mount.quobyte {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.backend_host         = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.chap_password        = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.chap_username        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.chiscsi_conf         = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.disk_geometry        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.driver_client_cert   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.driver_data_namespace = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.driver_use_ssl       = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.extra_capabilities   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.filter_function      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.goodness_function    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.iser_helper          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.iser_ip_address      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.iser_port            = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.iser_target_prefix   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_host             = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_login            = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_mount_options    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_password         = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_private_key      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_share_path       = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_ssh_port         = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.num_shell_tries      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.nvmet_port_id        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.replication_device   = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.report_discard_supported = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.reserved_percentage  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.scst_target_driver   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.storage_protocol     = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.target_helper        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.target_ip_address    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.target_port          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.target_prefix        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.target_protocol      = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.trace_flags          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.use_chap_auth        = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_clear         = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_clear_size    = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] QuobyteHD.volumes_dir          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack quobyte-client[88595]: Reading configuration file: /etc/quobyte/client.cfg
Jul 31 14:47:56 devstack quobyte-client[88595]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.ssl      = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_notifications.driver = [] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_notifications.retry = -1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] key_manager.fixed_key          = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.barbican_api_version  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.barbican_endpoint     = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.barbican_endpoint_type = public {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.barbican_region_name  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.cafile                = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.certfile              = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.collect_timing        = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.insecure              = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.keyfile               = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.number_of_retries     = 60 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.retry_delay           = 1 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.send_service_user_token = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.split_loggers         = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.timeout               = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.verify_ssl            = True {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican.verify_ssl_path       = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.auth_section = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.auth_type = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.cafile   = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.certfile = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.collect_timing = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.insecure = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.keyfile  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.split_loggers = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] barbican_service_user.timeout  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.approle_role_id          = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.approle_secret_id        = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.auth_method              = approle {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.auth_path                = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.kv_mountpoint            = secret {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.kv_path                  = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.kv_version               = 2 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.namespace                = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.root_token_id            = **** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.ssl_ca_crt_file          = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.timeout                  = 60.0 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.token_file               = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.token_role               = None {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.use_ssl                  = False {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 31 14:47:56 devstack cinder-volume[88296]: DEBUG oslo_service.backend._eventlet.service [None req-835e67d3-b958-4af0-a962-2a1f76e9d789 None None] ******************************************************************************** {{(pid=88296) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 31 14:47:56 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:47:56 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:57 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.231s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:57 devstack cinder-volume[88594]: INFO cinder.volume.driver [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Driver hasn't implemented _init_vendor_properties()
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.volume.driver [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6902122497559, 'free_capacity_gb': 1775.6902122497559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88594) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_db.sqlalchemy.engines [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writer thread running {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.db.api [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Building query based on filter {{(pid=88594) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88594) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:57 devstack cinder-volume[88594]: INFO cinder.keymgr.migration [None req-30bbfc41-9e9d-4d53-832b-ef5a0844aa38 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 31 14:47:57 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:47:57 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:57 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:47:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Driver initialization completed successfully.
Jul 31 14:47:57 devstack cinder-volume[88594]: INFO cinder.manager [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Initiating service 3 cleanup
Jul 31 14:47:57 devstack cinder-volume[88594]: INFO cinder.manager [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Service 3 cleanup completed.
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.service [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Creating RPC server for service cinder-volume {{(pid=88594) start /opt/stack/cinder/cinder/service.py:231}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.service [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88594) start /opt/stack/cinder/cinder/service.py:237}}
Jul 31 14:47:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:47:57 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:47:57 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:47:57 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.262s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:47:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c7b648e3-4f0a-48d7-b958-15e7ea1a7fe7 None None] Driver post RPC initialization completed successfully.
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 6 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:47:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:48:06 devstack cinder-volume[88296]: DEBUG dbcounter [-] [88296] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:48:07 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=2 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:48:07 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Flow 'volume_create_manager' (f942aa6a-6426-46e4-a928-01fc998263e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efb5661-d77b-4954-9df2-bcb2d83df5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efb5661-d77b-4954-9df2-bcb2d83df5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-669112800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4a9ea5-65bf-4191-926a-ccc1182cd0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38765ffdd13471985d39449a3794c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:48:56Z,use_quota=True,user_id='36793a681f6d4787aca053b69cba606a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a7b9c4-ab3f-4033-820e-7d0aa2e4129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a7b9c4-ab3f-4033-820e-7d0aa2e4129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf17ecaa-30b7-4270-8e7e-56302ad06ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf17ecaa-30b7-4270-8e7e-56302ad06ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4a9ea5-65bf-4191-926a-ccc1182cd0bb', 'volume_name': 'volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e23679c-2175-4827-9419-b98774afeeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e23679c-2175-4827-9419-b98774afeeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36174e4-def7-4825-8983-6087622ab00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:48:56 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Volume de4a9ea5-65bf-4191-926a-ccc1182cd0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb', 'volume_size': 1}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-669112800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4a9ea5-65bf-4191-926a-ccc1182cd0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38765ffdd13471985d39449a3794c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:48:56Z,use_quota=True,user_id='36793a681f6d4787aca053b69cba606a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Creating volume de4a9ea5-65bf-4191-926a-ccc1182cd0bb {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:48:56 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:48:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:48:56 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb 1073741824
Jul 31 14:48:56 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:48:56 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb 1073741824" returned: 0 in 0.636s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:48:57 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb
Jul 31 14:48:57 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:48:57 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb" returned: 0 in 0.632s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36174e4-def7-4825-8983-6087622ab00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23f6f05-f041-40a9-ba65-efb56fef1b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:48:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Volume volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb (de4a9ea5-65bf-4191-926a-ccc1182cd0bb): created successfully
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23f6f05-f041-40a9-ba65-efb56fef1b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Flow 'volume_create_manager' (f942aa6a-6426-46e4-a928-01fc998263e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:48:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8a7e6d78-0c7b-40a3-8814-95cd4548f2b9 tempest-TaggedAttachmentsTest-36973854 None] Created volume successfully.
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:48:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:48:57 devstack sudo[89467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:48:57 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:48:58 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root
Jul 31 14:48:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.407s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:48:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:48:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:48:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 6 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:48:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:49:07 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:49:07 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Flow 'volume_create_manager' (75ea4900-61fe-45cc-85bc-8143f5f72e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20c3b6f-312d-49f4-a2a5-61d7f29814c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20c3b6f-312d-49f4-a2a5-61d7f29814c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-922056580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3730a318-0e64-4db1-98cf-df4b18a62d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad554efa914ed88c7f7df6264c7481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:49:29Z,use_quota=True,user_id='d3cd4a3afe674bbbb38827f87f8106b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5a94d9-a270-43b8-8650-938f3d7fc9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5a94d9-a270-43b8-8650-938f3d7fc9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b0c9fa-6b60-4eb0-92ac-5e2c5eee585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b0c9fa-6b60-4eb0-92ac-5e2c5eee585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3730a318-0e64-4db1-98cf-df4b18a62d38', 'volume_name': 'volume-3730a318-0e64-4db1-98cf-df4b18a62d38', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93feb363-9f33-4ba3-8ad9-fdf642594491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93feb363-9f33-4ba3-8ad9-fdf642594491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb926d10-4b30-4b43-bb2f-bc8beac3e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Volume 3730a318-0e64-4db1-98cf-df4b18a62d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3730a318-0e64-4db1-98cf-df4b18a62d38', 'volume_size': 1}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-922056580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3730a318-0e64-4db1-98cf-df4b18a62d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad554efa914ed88c7f7df6264c7481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:49:29Z,use_quota=True,user_id='d3cd4a3afe674bbbb38827f87f8106b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Creating volume 3730a318-0e64-4db1-98cf-df4b18a62d38 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:49:29 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:49:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:29 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38 1073741824
Jul 31 14:49:29 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:30 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38 1073741824" returned: 0 in 1.060s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:30 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38
Jul 31 14:49:30 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:49:31 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Flow 'volume_create_manager' (2667e074-9667-4b5d-a075-ca3a693af896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3036605b-42eb-44bd-a51b-f5676c0138cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38" returned: 0 in 0.610s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3036605b-42eb-44bd-a51b-f5676c0138cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1294570876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755d055-9ab8-4f09-8045-dfe26eb3c560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404aae361d3c4b06ba3ed340804f9a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:49:31Z,use_quota=True,user_id='34416008cf0b43829d885dfc8ee39813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aac5df1-29fe-4017-8a93-e00e185d2d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aac5df1-29fe-4017-8a93-e00e185d2d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a85a10a-4b9b-465e-86fa-548ff26d510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a85a10a-4b9b-465e-86fa-548ff26d510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6755d055-9ab8-4f09-8045-dfe26eb3c560', 'volume_name': 'volume-6755d055-9ab8-4f09-8045-dfe26eb3c560', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff9ba61-6be1-40e0-8858-232e4d151692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff9ba61-6be1-40e0-8858-232e4d151692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4fe7a8-4fac-49c3-8e53-2de56e90dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Volume 6755d055-9ab8-4f09-8045-dfe26eb3c560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6755d055-9ab8-4f09-8045-dfe26eb3c560', 'volume_size': 1}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1294570876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755d055-9ab8-4f09-8045-dfe26eb3c560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404aae361d3c4b06ba3ed340804f9a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:49:31Z,use_quota=True,user_id='34416008cf0b43829d885dfc8ee39813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Creating volume 6755d055-9ab8-4f09-8045-dfe26eb3c560 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:49:31 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:31 devstack sudo[89992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560 1073741824
Jul 31 14:49:31 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb926d10-4b30-4b43-bb2f-bc8beac3e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3730a318-0e64-4db1-98cf-df4b18a62d38', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef71e964-e529-45b1-8698-98ae067b243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Volume volume-3730a318-0e64-4db1-98cf-df4b18a62d38 (3730a318-0e64-4db1-98cf-df4b18a62d38): created successfully
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef71e964-e529-45b1-8698-98ae067b243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Flow 'volume_create_manager' (75ea4900-61fe-45cc-85bc-8143f5f72e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:49:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a5d9363d-8b5d-4272-8480-3bc472f4189a tempest-VolumesAdminNegativeTest-174502622 None] Created volume successfully.
Jul 31 14:49:32 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560 1073741824" returned: 0 in 0.945s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:32 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560
Jul 31 14:49:32 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:33 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560" returned: 0 in 0.449s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:49:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:49:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4fe7a8-4fac-49c3-8e53-2de56e90dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6755d055-9ab8-4f09-8045-dfe26eb3c560', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412aae11-630b-441b-9d49-1f67dff4266a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:49:33 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Volume volume-6755d055-9ab8-4f09-8045-dfe26eb3c560 (6755d055-9ab8-4f09-8045-dfe26eb3c560): created successfully
Jul 31 14:49:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412aae11-630b-441b-9d49-1f67dff4266a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:49:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Flow 'volume_create_manager' (2667e074-9667-4b5d-a075-ca3a693af896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:49:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9e139d2b-3f11-4811-80cd-3fb3a3cd4fa7 tempest-ServerRescueNegativeTestJSON-1809079336 None] Created volume successfully.
Jul 31 14:49:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Acquiring lock "cinder-3730a318-0e64-4db1-98cf-df4b18a62d38-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:49:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Lock "cinder-3730a318-0e64-4db1-98cf-df4b18a62d38-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:49:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Acquiring lock "cinder-quobyte-3730a318-0e64-4db1-98cf-df4b18a62d38" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:49:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Lock "cinder-quobyte-3730a318-0e64-4db1-98cf-df4b18a62d38" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:49:34 devstack cinder-volume[88594]: INFO oslo.privsep.daemon [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyx8t42__/privsep.sock']
Jul 31 14:49:34 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyx8t42__/privsep.sock
Jul 31 14:49:34 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 31 14:49:36 devstack cinder-volume[88594]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Jul 31 14:49:37 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:37 devstack cinder-volume[88594]: INFO oslo.privsep.daemon [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Spawned new privsep daemon via rootwrap
Jul 31 14:49:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Accepted privsep connection to /tmp/tmpyx8t42__/privsep.sock {{(pid=88594) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 31 14:49:37 devstack cinder-volume[88594]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 14:49:37 devstack cinder-volume[88594]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 14:49:37 devstack cinder-volume[88594]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 31 14:49:37 devstack cinder-volume[88594]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90006
Jul 31 14:49:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef3e636-f553-417f-8f4b-8002a043b09d]: (2,) {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:49:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd73861-2e83-4094-a0b1-6a1f9adb7fb8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:49:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:37 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38
Jul 31 14:49:37 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:38 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38" returned: 0 in 1.241s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:38 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38
Jul 31 14:49:38 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:39 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3730a318-0e64-4db1-98cf-df4b18a62d38" returned: 0 in 0.684s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Lock "cinder-quobyte-3730a318-0e64-4db1-98cf-df4b18a62d38" released by "delete_volume" :: held 4.752s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:49:39 devstack cinder-volume[88594]: WARNING cinder.quota [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:49:39 devstack cinder-volume[88594]: WARNING cinder.quota [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Created reservations ['3f7c08c1-5f34-42af-af76-8f58a998b535', '19880c25-a464-4ad8-a07c-f6138c2f16db', '1a9aa447-2b14-4d04-ae8d-58552a28127b', '08ff7fcb-d6e9-4e4f-b510-facf9bcacd20'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:49:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:39 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:49:39 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:40 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.451s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:40 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:49:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Deleted volume successfully.
Jul 31 14:49:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-18fb66a7-a520-4de1-8f98-fd1ef8bfd084 tempest-VolumesAdminNegativeTest-174502622 None] Lock "cinder-3730a318-0e64-4db1-98cf-df4b18a62d38-delete_volume" released by "delete_volume" :: held 5.992s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:49:49 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:49:50 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:49:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:49:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:49:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:49:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:49:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:49:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:49:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:49:57 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:49:57 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:49:58 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Jul 31 14:49:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.463s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:49:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Acquiring lock "cinder-6755d055-9ab8-4f09-8045-dfe26eb3c560-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "cinder-6755d055-9ab8-4f09-8045-dfe26eb3c560-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Acquiring lock "cinder-quobyte-6755d055-9ab8-4f09-8045-dfe26eb3c560" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "cinder-quobyte-6755d055-9ab8-4f09-8045-dfe26eb3c560" acquired by "delete_volume" :: waited 0.043s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:03 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2fcd25-e4fe-479b-adef-ea6cc7d940c3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:03 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560
Jul 31 14:50:03 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:03 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560" returned: 0 in 0.624s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:03 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560
Jul 31 14:50:03 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:04 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6755d055-9ab8-4f09-8045-dfe26eb3c560" returned: 0 in 0.384s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "cinder-quobyte-6755d055-9ab8-4f09-8045-dfe26eb3c560" released by "delete_volume" :: held 1.117s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Created reservations ['da2f583e-74e9-44e0-a6e6-dcc0e4ff63fd', 'a514bd02-4318-407b-ae2b-0ac9d84847cb', '53cbf11a-c7ab-45eb-a1d9-fb4e44ff4395', '5361f45b-918b-47df-8a6d-48383aa675e3'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:04 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:04 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:04 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.303s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Deleted volume successfully.
Jul 31 14:50:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1b5f47c0-db9d-42b3-a23b-f021ca3dd7e8 tempest-ServerRescueNegativeTestJSON-1809079336 None] Lock "cinder-6755d055-9ab8-4f09-8045-dfe26eb3c560-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Flow 'volume_create_manager' (79972b40-7ba2-4f24-9eee-cd83da0c743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857b9ebe-a2d8-4428-aa2d-9241b834e277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857b9ebe-a2d8-4428-aa2d-9241b834e277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1601532834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f8f962-3d5b-4cf0-97bf-63112461adfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63354071b1844f6e85d89d91c3cfeb14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:11Z,use_quota=True,user_id='1258eb48164d4d50a3d34897221d2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561a3e2d-e83a-48fa-9fb7-002113fe9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561a3e2d-e83a-48fa-9fb7-002113fe9e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c104aa-82c2-4ff2-bb40-1a0a822be830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c104aa-82c2-4ff2-bb40-1a0a822be830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f8f962-3d5b-4cf0-97bf-63112461adfa', 'volume_name': 'volume-80f8f962-3d5b-4cf0-97bf-63112461adfa', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd5159e-ddda-44dd-b049-241ec1698976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd5159e-ddda-44dd-b049-241ec1698976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3382aaeb-ebc7-4ba0-a5f4-2e90f9e68935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Volume 80f8f962-3d5b-4cf0-97bf-63112461adfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f8f962-3d5b-4cf0-97bf-63112461adfa', 'volume_size': 1}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1601532834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f8f962-3d5b-4cf0-97bf-63112461adfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63354071b1844f6e85d89d91c3cfeb14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:11Z,use_quota=True,user_id='1258eb48164d4d50a3d34897221d2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Creating volume 80f8f962-3d5b-4cf0-97bf-63112461adfa {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:50:11 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:50:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:11 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa 1073741824
Jul 31 14:50:11 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:12 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa 1073741824" returned: 0 in 0.813s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:12 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa
Jul 31 14:50:12 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:13 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa" returned: 0 in 0.510s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:50:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3382aaeb-ebc7-4ba0-a5f4-2e90f9e68935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f8f962-3d5b-4cf0-97bf-63112461adfa', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9614ba2-6904-4da6-8069-b8bb8edd1923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:13 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Volume volume-80f8f962-3d5b-4cf0-97bf-63112461adfa (80f8f962-3d5b-4cf0-97bf-63112461adfa): created successfully
Jul 31 14:50:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9614ba2-6904-4da6-8069-b8bb8edd1923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Flow 'volume_create_manager' (79972b40-7ba2-4f24-9eee-cd83da0c743a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-96e659d0-3df0-4a40-9a98-f5a76fb82d40 tempest-DeleteServersTestJSON-1341563610 None] Created volume successfully.
Jul 31 14:50:17 devstack cinder-volume[88594]: WARNING py.warnings [req-eb8b3c9f-14b0-48a9-bedc-d84865dbcc0e req-2c5079d2-5c4e-4405-a232-5d0240b49e81 tempest-DeleteServersTestJSON-1341563610 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 31 14:50:17 devstack cinder-volume[88594]:   .first()
Jul 31 14:50:17 devstack cinder-volume[88594]: 
Jul 31 14:50:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eb8b3c9f-14b0-48a9-bedc-d84865dbcc0e req-2c5079d2-5c4e-4405-a232-5d0240b49e81 tempest-DeleteServersTestJSON-1341563610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eb8b3c9f-14b0-48a9-bedc-d84865dbcc0e req-2c5079d2-5c4e-4405-a232-5d0240b49e81 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eb8b3c9f-14b0-48a9-bedc-d84865dbcc0e req-2c5079d2-5c4e-4405-a232-5d0240b49e81 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-eb8b3c9f-14b0-48a9-bedc-d84865dbcc0e req-2c5079d2-5c4e-4405-a232-5d0240b49e81 tempest-DeleteServersTestJSON-1341563610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-80f8f962-3d5b-4cf0-97bf-63112461adfa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c521031e-1ded-4985-a35f-60da6f7583b8', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:50:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-eb8b3c9f-14b0-48a9-bedc-d84865dbcc0e req-2c5079d2-5c4e-4405-a232-5d0240b49e81 tempest-DeleteServersTestJSON-1341563610 None] attachment_update completed successfully.
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Flow 'volume_create_manager' (30e5e6ee-b44c-48bf-9771-16993c72de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1e0200-c9a4-4c8c-ae3a-4a97bd8879b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1e0200-c9a4-4c8c-ae3a-4a97bd8879b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1004598214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9f0346-252b-4fc5-b16b-d283fb057b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8f67756fc4103ad8802bb811956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:20Z,use_quota=True,user_id='8b4d4758dbd5446f807ffc11f10b6f0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccd3db9-6749-495a-8ea8-337dfd75d36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccd3db9-6749-495a-8ea8-337dfd75d36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a59e84-bb35-4fc1-bd56-f4b8a92a5b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a59e84-bb35-4fc1-bd56-f4b8a92a5b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9f0346-252b-4fc5-b16b-d283fb057b5f', 'volume_name': 'volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655910ff-76aa-4cda-82cb-82bd5116b1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655910ff-76aa-4cda-82cb-82bd5116b1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9d838d-4572-4a9b-8ba2-341cdfddcbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:20 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Volume 0e9f0346-252b-4fc5-b16b-d283fb057b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f', 'volume_size': 1}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1004598214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9f0346-252b-4fc5-b16b-d283fb057b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8f67756fc4103ad8802bb811956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:20Z,use_quota=True,user_id='8b4d4758dbd5446f807ffc11f10b6f0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Creating volume 0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:50:20 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:20 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f 1073741824
Jul 31 14:50:20 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:20 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f 1073741824" returned: 0 in 0.826s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:20 devstack sudo[90926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f
Jul 31 14:50:20 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:21 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f" returned: 0 in 0.849s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:50:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9d838d-4572-4a9b-8ba2-341cdfddcbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ef1687-b3ad-438a-99df-42de2bc6831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:21 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Volume volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f (0e9f0346-252b-4fc5-b16b-d283fb057b5f): created successfully
Jul 31 14:50:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ef1687-b3ad-438a-99df-42de2bc6831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Flow 'volume_create_manager' (30e5e6ee-b44c-48bf-9771-16993c72de3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-7020b444-8f10-4c75-aa78-8662e601d65b req-08d008bb-ed0f-47d7-86b8-af9b50fe62be tempest-VolumesSnapshotsTestJSON-1267547725 None] Created volume successfully.
Jul 31 14:50:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Creating offline snapshot 1d2d1bdb-369c-46dd-ac7c-325eb283318a of volume 0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:50:23 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd1900-99a0-4ccb-afaa-6bbd1ac01a86]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:23 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f
Jul 31 14:50:23 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:24 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f" returned: 0 in 0.584s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:24 devstack sudo[91048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a 1G
Jul 31 14:50:24 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:24 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-35187f27-b2ec-4253-9f27-5c773e2804e3 req-4989cfa8-5ac9-4535-8bb6-73ff0d061912 tempest-DeleteServersTestJSON-1341563610 None] Terminate volume connection completed successfully.
Jul 31 14:50:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-35187f27-b2ec-4253-9f27-5c773e2804e3 req-4989cfa8-5ac9-4535-8bb6-73ff0d061912 tempest-DeleteServersTestJSON-1341563610 None] Deleting attachment c521031e-1ded-4985-a35f-60da6f7583b8. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:50:24 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a 1G" returned: 0 in 0.641s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:24 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a
Jul 31 14:50:24 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-97592353-f8cc-4e60-85af-0d60a6097ad9 req-b67ba3e4-e75d-4afc-b6ee-af629cfa25e9 tempest-TaggedAttachmentsTest-36973854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:25 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a" returned: 0 in 0.352s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:25 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a is being set with open permissions: ugo+rw
Jul 31 14:50:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:25 devstack sudo[91078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a
Jul 31 14:50:25 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:25 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a" returned: 0 in 0.261s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:25 devstack sudo[91081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.info
Jul 31 14:50:25 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:25 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.info" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:25 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.info is being set with open permissions: ugo+rw
Jul 31 14:50:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:25 devstack sudo[91085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.info
Jul 31 14:50:25 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Acquiring lock "cinder-80f8f962-3d5b-4cf0-97bf-63112461adfa-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Lock "cinder-80f8f962-3d5b-4cf0-97bf-63112461adfa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:26 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.info" returned: 0 in 0.310s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-97592353-f8cc-4e60-85af-0d60a6097ad9 req-b67ba3e4-e75d-4afc-b6ee-af629cfa25e9 tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.227s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Acquiring lock "cinder-quobyte-80f8f962-3d5b-4cf0-97bf-63112461adfa" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:26 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-eda9e299-fee7-46ed-b1f9-720b16fd0b66 req-4315d4d3-3b58-4537-a480-00478d1101ce tempest-VolumesSnapshotsTestJSON-1267547725 None] Create snapshot completed successfully
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Lock "cinder-quobyte-80f8f962-3d5b-4cf0-97bf-63112461adfa" acquired by "delete_volume" :: waited 0.040s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-97592353-f8cc-4e60-85af-0d60a6097ad9 req-b67ba3e4-e75d-4afc-b6ee-af629cfa25e9 tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.113s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948bfe7-8923-46ae-b693-afcc2c6c0587]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-97592353-f8cc-4e60-85af-0d60a6097ad9 req-b67ba3e4-e75d-4afc-b6ee-af629cfa25e9 tempest-TaggedAttachmentsTest-36973854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f192992d-5b16-4a21-8acf-e79f82f96aba', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:50:26 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-97592353-f8cc-4e60-85af-0d60a6097ad9 req-b67ba3e4-e75d-4afc-b6ee-af629cfa25e9 tempest-TaggedAttachmentsTest-36973854 None] attachment_update completed successfully.
Jul 31 14:50:26 devstack sudo[91089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa
Jul 31 14:50:26 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:26 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa" returned: 0 in 0.452s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:26 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa
Jul 31 14:50:26 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "cinder-1d2d1bdb-369c-46dd-ac7c-325eb283318a-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-1d2d1bdb-369c-46dd-ac7c-325eb283318a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "cinder-quobyte-0e9f0346-252b-4fc5-b16b-d283fb057b5f" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:27 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-80f8f962-3d5b-4cf0-97bf-63112461adfa" returned: 0 in 0.402s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Lock "cinder-quobyte-80f8f962-3d5b-4cf0-97bf-63112461adfa" released by "delete_volume" :: held 0.908s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-quobyte-0e9f0346-252b-4fc5-b16b-d283fb057b5f" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "cinder-quobyte-1d2d1bdb-369c-46dd-ac7c-325eb283318a" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-quobyte-1d2d1bdb-369c-46dd-ac7c-325eb283318a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Deleting offline snapshot 1d2d1bdb-369c-46dd-ac7c-325eb283318a of volume 0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] snapshot_file for this snap is: volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ec27f-a8a4-4019-a010-8830f06b05ef]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Created reservations ['cc88f887-7351-48a1-8188-8fdc2f5bc88e', '1e553dda-6f2e-40b9-9583-65218918d2a2', '9f522150-fa7c-4834-9f75-406a3bc94ffc', '88f30693-af0d-4398-95eb-8a44693793a7'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:27 devstack sudo[91483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a
Jul 31 14:50:27 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:27 devstack sudo[91485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:27 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:27 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.313s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:27 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a" returned: 0 in 0.494s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:50:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Deleted volume successfully.
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee78db-4f34-4e1e-b093-c17d23fcc071]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c3a3213-c669-46a8-af18-b223c69fa296 tempest-DeleteServersTestJSON-1341563610 None] Lock "cinder-80f8f962-3d5b-4cf0-97bf-63112461adfa-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:27 devstack sudo[91491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f
Jul 31 14:50:27 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:28 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f" returned: 0 in 0.405s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:28 devstack sudo[91501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a
Jul 31 14:50:28 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:28 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a" returned: 0 in 0.460s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:28 devstack sudo[91506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a
Jul 31 14:50:28 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:28 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f.1d2d1bdb-369c-46dd-ac7c-325eb283318a" returned: 0 in 0.318s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-quobyte-1d2d1bdb-369c-46dd-ac7c-325eb283318a" released by "_delete_snapshot" :: held 1.830s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-quobyte-0e9f0346-252b-4fc5-b16b-d283fb057b5f" released by "delete_snapshot" :: held 1.860s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:29 devstack cinder-volume[88594]: WARNING cinder.quota [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG cinder.quota [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Created reservations ['98a8801d-d926-485c-a0af-53cb321961ba', '8b4d917d-d0b0-47d7-8ccf-0032eeed0c97', 'f4657e1f-3d8a-464d-aa8d-3d73671ef4df', '05b409f8-0770-4571-b507-5df1a997ff00'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Delete snapshot completed successfully.
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-57336d2d-b2b2-43fb-bda9-ed5370e7fe55 req-afa898df-133a-40cb-95fc-467a5812f9d9 tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-1d2d1bdb-369c-46dd-ac7c-325eb283318a-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-15148810-9e2a-4959-9506-2a7fa6136a03 req-15367c94-4a27-4fa5-bf4d-c7dad6edfe01 tempest-TaggedAttachmentsTest-36973854 None] Terminate volume connection completed successfully.
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-15148810-9e2a-4959-9506-2a7fa6136a03 req-15367c94-4a27-4fa5-bf4d-c7dad6edfe01 tempest-TaggedAttachmentsTest-36973854 None] Deleting attachment f192992d-5b16-4a21-8acf-e79f82f96aba. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "cinder-0e9f0346-252b-4fc5-b16b-d283fb057b5f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-0e9f0346-252b-4fc5-b16b-d283fb057b5f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "cinder-quobyte-0e9f0346-252b-4fc5-b16b-d283fb057b5f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-quobyte-0e9f0346-252b-4fc5-b16b-d283fb057b5f" acquired by "delete_volume" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac921e-eec6-47e1-bc26-b1dd45af1759]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:29 devstack sudo[91539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f
Jul 31 14:50:29 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:30 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f" returned: 0 in 0.532s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:30 devstack sudo[91545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f
Jul 31 14:50:30 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0e9f0346-252b-4fc5-b16b-d283fb057b5f" returned: 0 in 0.302s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:30 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-quobyte-0e9f0346-252b-4fc5-b16b-d283fb057b5f" released by "delete_volume" :: held 0.945s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG cinder.quota [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Created reservations ['cb7a698f-d5cf-464e-a762-92ccc31f13a6', '26644ad7-a9ca-4859-93d2-72daa52889b7', '188687a1-3197-4a59-aa78-fd40f0bf2937', 'bcdc8b27-73e2-40b2-b745-7c675c530354'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:30 devstack sudo[91565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:30 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:31 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:31 devstack cinder-volume[88594]: DEBUG cinder.manager [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Deleted volume successfully.
Jul 31 14:50:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-ae6971ec-b1d1-4318-b1bc-b42e16071e04 req-d2452b22-e217-46fc-a17e-1f183b7e354f tempest-VolumesSnapshotsTestJSON-1267547725 None] Lock "cinder-0e9f0346-252b-4fc5-b16b-d283fb057b5f-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Flow 'volume_create_manager' (2705c53c-81a8-4fa5-82c9-e6e717feb7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3515f033-528c-489f-8a0c-5ebc3a4f320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3515f033-528c-489f-8a0c-5ebc3a4f320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1751355321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e32348b-e53e-4668-b06d-53f486bd2c19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bada79c6e66645328ba3586e5fa4eb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:40Z,use_quota=True,user_id='4b3d80d2f5c04c70a2634a9e1f5cf742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197495e4-9d47-4e11-8fd8-4548c04c70e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197495e4-9d47-4e11-8fd8-4548c04c70e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c678ceb-0d8d-4ba7-83ef-db74539dc8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c678ceb-0d8d-4ba7-83ef-db74539dc8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e32348b-e53e-4668-b06d-53f486bd2c19', 'volume_name': 'volume-9e32348b-e53e-4668-b06d-53f486bd2c19', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3271990d-1088-4896-a2b8-a2e01a5603b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3271990d-1088-4896-a2b8-a2e01a5603b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca60559e-8058-4568-ab7b-6812f20c21d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Volume 9e32348b-e53e-4668-b06d-53f486bd2c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e32348b-e53e-4668-b06d-53f486bd2c19', 'volume_size': 1}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1751355321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e32348b-e53e-4668-b06d-53f486bd2c19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bada79c6e66645328ba3586e5fa4eb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:40Z,use_quota=True,user_id='4b3d80d2f5c04c70a2634a9e1f5cf742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Creating volume 9e32348b-e53e-4668-b06d-53f486bd2c19 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:50:39 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:50:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:39 devstack sudo[91607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19 1073741824
Jul 31 14:50:39 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:40 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19 1073741824" returned: 0 in 0.696s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:40 devstack sudo[91615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19
Jul 31 14:50:40 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:40 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca60559e-8058-4568-ab7b-6812f20c21d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e32348b-e53e-4668-b06d-53f486bd2c19', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114d617c-613b-46ae-8cf7-0174d1c6974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Volume volume-9e32348b-e53e-4668-b06d-53f486bd2c19 (9e32348b-e53e-4668-b06d-53f486bd2c19): created successfully
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114d617c-613b-46ae-8cf7-0174d1c6974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Flow 'volume_create_manager' (2705c53c-81a8-4fa5-82c9-e6e717feb7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5cd43914-23c1-4c21-984f-ba4f0dfdc31c tempest-VolumesTestJSON-484153172 None] Created volume successfully.
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Flow 'volume_create_manager' (7d19e2bd-67da-4c39-bcc1-7cfe17078d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7e4293-4e40-42c1-a37d-56eb930aaaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7e4293-4e40-42c1-a37d-56eb930aaaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52768568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330552b3-8086-45ad-9985-9abce664bad0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bada79c6e66645328ba3586e5fa4eb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:42Z,use_quota=True,user_id='4b3d80d2f5c04c70a2634a9e1f5cf742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2b7148-fea2-4d7d-9e8c-e045c555b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2b7148-fea2-4d7d-9e8c-e045c555b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b834dbc-92dc-4e1a-8044-598388350d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b834dbc-92dc-4e1a-8044-598388350d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330552b3-8086-45ad-9985-9abce664bad0', 'volume_name': 'volume-330552b3-8086-45ad-9985-9abce664bad0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e16fba3-4179-42f9-8781-fd6961bad8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e16fba3-4179-42f9-8781-fd6961bad8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf75fdd0-0faf-4512-8a62-d20a04fd9ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Volume 330552b3-8086-45ad-9985-9abce664bad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330552b3-8086-45ad-9985-9abce664bad0', 'volume_size': 1}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52768568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330552b3-8086-45ad-9985-9abce664bad0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bada79c6e66645328ba3586e5fa4eb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:42Z,use_quota=True,user_id='4b3d80d2f5c04c70a2634a9e1f5cf742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Creating volume 330552b3-8086-45ad-9985-9abce664bad0 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:50:42 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:50:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:42 devstack sudo[91626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0 1073741824
Jul 31 14:50:42 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:43 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0 1073741824" returned: 0 in 0.591s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:43 devstack sudo[91632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0
Jul 31 14:50:43 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:43 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0" returned: 0 in 0.462s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf75fdd0-0faf-4512-8a62-d20a04fd9ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330552b3-8086-45ad-9985-9abce664bad0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438f4597-7740-4caf-a2ee-a24a6834bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:43 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Volume volume-330552b3-8086-45ad-9985-9abce664bad0 (330552b3-8086-45ad-9985-9abce664bad0): created successfully
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438f4597-7740-4caf-a2ee-a24a6834bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Flow 'volume_create_manager' (7d19e2bd-67da-4c39-bcc1-7cfe17078d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-74ed450a-e4f0-4490-94bc-b71a4644c1e0 tempest-VolumesTestJSON-484153172 None] Created volume successfully.
Jul 31 14:50:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Acquiring lock "cinder-de4a9ea5-65bf-4191-926a-ccc1182cd0bb-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Lock "cinder-de4a9ea5-65bf-4191-926a-ccc1182cd0bb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Acquiring lock "cinder-quobyte-de4a9ea5-65bf-4191-926a-ccc1182cd0bb" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Lock "cinder-quobyte-de4a9ea5-65bf-4191-926a-ccc1182cd0bb" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cf7819-7fd7-4157-a7a5-f18be317ad15]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:44 devstack sudo[91647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb
Jul 31 14:50:44 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:44 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb" returned: 0 in 0.398s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:44 devstack sudo[91658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb
Jul 31 14:50:44 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:44 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-de4a9ea5-65bf-4191-926a-ccc1182cd0bb" returned: 0 in 0.424s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Lock "cinder-quobyte-de4a9ea5-65bf-4191-926a-ccc1182cd0bb" released by "delete_volume" :: held 0.876s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Created reservations ['7386e1b2-875d-4bd6-9cac-a9401a892ce5', 'b2be3a25-3642-403f-8d14-c18bf86b8143', '9fec4b74-53a9-4067-8f44-b17da230e175', 'b60c932d-2f03-454b-bbe9-f92cdd41f129'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:45 devstack sudo[91661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:45 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Flow 'volume_create_manager' (44ce32d1-c566-4527-830e-e79efddbf776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e76264-df22-44f8-92ec-b67f51913704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e76264-df22-44f8-92ec-b67f51913704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-845971221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6338acbd-9fe4-4f7d-9e86-3a87fbfac63e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bada79c6e66645328ba3586e5fa4eb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:45Z,use_quota=True,user_id='4b3d80d2f5c04c70a2634a9e1f5cf742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32872f87-2891-428f-8c2a-3ae3398bb240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32872f87-2891-428f-8c2a-3ae3398bb240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b65eaa-d489-4ab4-b64b-15dab32ef504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:45 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b65eaa-d489-4ab4-b64b-15dab32ef504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6338acbd-9fe4-4f7d-9e86-3a87fbfac63e', 'volume_name': 'volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af5cab4-828f-4014-9bb0-b4aaabb73146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af5cab4-828f-4014-9bb0-b4aaabb73146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0ad169-85b0-4648-b79a-12b62ab18ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:45 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Volume 6338acbd-9fe4-4f7d-9e86-3a87fbfac63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e', 'volume_size': 1}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-845971221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6338acbd-9fe4-4f7d-9e86-3a87fbfac63e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bada79c6e66645328ba3586e5fa4eb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:50:45Z,use_quota=True,user_id='4b3d80d2f5c04c70a2634a9e1f5cf742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Creating volume 6338acbd-9fe4-4f7d-9e86-3a87fbfac63e {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:50:45 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.415s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Deleted volume successfully.
Jul 31 14:50:45 devstack sudo[91664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e 1073741824
Jul 31 14:50:45 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2d55451a-e182-41f3-a11b-6a73f896240b tempest-TaggedAttachmentsTest-36973854 None] Lock "cinder-de4a9ea5-65bf-4191-926a-ccc1182cd0bb-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:46 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e 1073741824" returned: 0 in 0.503s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:46 devstack sudo[91673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e
Jul 31 14:50:46 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:46 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0ad169-85b0-4648-b79a-12b62ab18ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5093f4a6-9343-4b86-88d0-5de043ef47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:50:46 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Volume volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e (6338acbd-9fe4-4f7d-9e86-3a87fbfac63e): created successfully
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5093f4a6-9343-4b86-88d0-5de043ef47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:50:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Flow 'volume_create_manager' (44ce32d1-c566-4527-830e-e79efddbf776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:50:46 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b43c201c-cc53-4106-af29-aacffd8182ef tempest-VolumesTestJSON-484153172 None] Created volume successfully.
Jul 31 14:50:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Acquiring lock "cinder-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Lock "cinder-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Acquiring lock "cinder-quobyte-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Lock "cinder-quobyte-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:48 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92dc5d5-1f0f-4563-936c-50c0179646b0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:49 devstack sudo[91679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e
Jul 31 14:50:49 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:49 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e" returned: 0 in 0.403s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:49 devstack sudo[91684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e
Jul 31 14:50:49 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:49 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e" returned: 0 in 0.310s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Lock "cinder-quobyte-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e" released by "delete_volume" :: held 0.768s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Created reservations ['1598f0e1-afeb-4c9e-8e6e-20d55c2e5807', 'e2abec81-112e-4ac1-a9f3-51375f1af941', '7f7ca067-b6e8-439c-904b-4365d4c2b7ef', '0d57ab71-9fe5-4cc3-aa1d-37255dfdc83b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:49 devstack sudo[91688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:49 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Acquiring lock "cinder-330552b3-8086-45ad-9985-9abce664bad0-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Lock "cinder-330552b3-8086-45ad-9985-9abce664bad0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=65,cinder:UPDATE=68,cinder:INSERT=14,cinder:DELETE=6 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:50:50 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.293s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Acquiring lock "cinder-quobyte-330552b3-8086-45ad-9985-9abce664bad0" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Deleted volume successfully.
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Lock "cinder-quobyte-330552b3-8086-45ad-9985-9abce664bad0" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f353f4ca-8e1f-48d5-87d8-0e54d841b6b2 tempest-VolumesTestJSON-484153172 None] Lock "cinder-6338acbd-9fe4-4f7d-9e86-3a87fbfac63e-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe637873-2efb-42c7-947c-c3648b5e3527]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:50 devstack sudo[91691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0
Jul 31 14:50:50 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:50 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0" returned: 0 in 0.430s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:50 devstack sudo[91696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0
Jul 31 14:50:50 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:50 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-330552b3-8086-45ad-9985-9abce664bad0" returned: 0 in 0.268s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Lock "cinder-quobyte-330552b3-8086-45ad-9985-9abce664bad0" released by "delete_volume" :: held 0.766s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Created reservations ['f60042e3-9279-4db3-82b0-8672d381aa1d', 'ee58dcc6-4cfa-4533-8f86-eebc8962cbfd', '82f4ccd3-3cc0-47fc-8350-625e278b93bf', '9b476058-8ac9-42ff-aa9b-1d68892a2793'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:51 devstack sudo[91699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:51 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Acquiring lock "cinder-9e32348b-e53e-4668-b06d-53f486bd2c19-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Lock "cinder-9e32348b-e53e-4668-b06d-53f486bd2c19-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:51 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.317s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Acquiring lock "cinder-quobyte-9e32348b-e53e-4668-b06d-53f486bd2c19" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:50:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Deleted volume successfully.
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Lock "cinder-quobyte-9e32348b-e53e-4668-b06d-53f486bd2c19" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68d4b11d-28ea-4bfe-8b82-8b65b6d8bcdb tempest-VolumesTestJSON-484153172 None] Lock "cinder-330552b3-8086-45ad-9985-9abce664bad0-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0545c7b3-8dbe-4ab8-bb8d-2ae7b6682a59]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:51 devstack sudo[91702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19
Jul 31 14:50:51 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:51 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19" returned: 0 in 0.464s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:52 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19
Jul 31 14:50:52 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:52 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9e32348b-e53e-4668-b06d-53f486bd2c19" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Lock "cinder-quobyte-9e32348b-e53e-4668-b06d-53f486bd2c19" released by "delete_volume" :: held 0.784s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Created reservations ['d0bd6dfc-dee0-4194-88b1-07640fa367bc', '7f9581cd-d84e-4585-92e5-88a138a41237', '7714f955-7dd4-4a14-b4fe-680247d538ca', 'f4ed082a-0612-4555-9829-e194f7c878a2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:52 devstack sudo[91711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:52 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:52 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.310s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:52 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Deleted volume successfully.
Jul 31 14:50:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ba334320-1cd4-4b08-b89a-eff1706c0976 tempest-VolumesTestJSON-484153172 None] Lock "cinder-9e32348b-e53e-4668-b06d-53f486bd2c19-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:50:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:50:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:50:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:50:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:50:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:50:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:50:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:50:58 devstack sudo[91804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:50:58 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:50:58 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root
Jul 31 14:50:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.820s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:50:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:50:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:50:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 8 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:50:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:51:02 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=81,cinder:SELECT=62,cinder:INSERT=21,cinder:DELETE=6 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:51:02 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Flow 'volume_create_manager' (e2b0c721-b75a-45f4-b0ef-fb5735f2e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1390137a-cabe-404b-9a4c-117178a7a189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1390137a-cabe-404b-9a4c-117178a7a189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-988343597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59308b6b-a087-403a-aae3-b226f57141b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918dfe9d62014fe3bac9f511230e994f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:17Z,use_quota=True,user_id='890ac398482e4b549bb5c209cee9270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67593bc4-0a83-4ffa-bad7-d78ad0302d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67593bc4-0a83-4ffa-bad7-d78ad0302d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b69a276-c070-4fc5-ae12-8f4a276ee867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b69a276-c070-4fc5-ae12-8f4a276ee867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59308b6b-a087-403a-aae3-b226f57141b2', 'volume_name': 'volume-59308b6b-a087-403a-aae3-b226f57141b2', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1155738e-e05a-474c-97a1-632c005a4f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1155738e-e05a-474c-97a1-632c005a4f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ea837a-0197-4e52-a6c2-e6942df46bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:17 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Volume 59308b6b-a087-403a-aae3-b226f57141b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59308b6b-a087-403a-aae3-b226f57141b2', 'volume_size': 1}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-988343597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59308b6b-a087-403a-aae3-b226f57141b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918dfe9d62014fe3bac9f511230e994f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:17Z,use_quota=True,user_id='890ac398482e4b549bb5c209cee9270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Creating volume 59308b6b-a087-403a-aae3-b226f57141b2 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:51:17 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:17 devstack sudo[92027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2 1073741824
Jul 31 14:51:17 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:17 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2 1073741824" returned: 0 in 0.546s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:17 devstack sudo[92034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2
Jul 31 14:51:17 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:18 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2" returned: 0 in 0.450s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:51:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ea837a-0197-4e52-a6c2-e6942df46bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59308b6b-a087-403a-aae3-b226f57141b2', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74281901-fdfd-4589-8ad2-93332e73ee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Volume volume-59308b6b-a087-403a-aae3-b226f57141b2 (59308b6b-a087-403a-aae3-b226f57141b2): created successfully
Jul 31 14:51:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74281901-fdfd-4589-8ad2-93332e73ee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Flow 'volume_create_manager' (e2b0c721-b75a-45f4-b0ef-fb5735f2e83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-78b9b394-7e19-4ab1-a946-a08a1e9d0797 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Created volume successfully.
Jul 31 14:51:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Acquiring lock "cinder-59308b6b-a087-403a-aae3-b226f57141b2-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "cinder-59308b6b-a087-403a-aae3-b226f57141b2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Acquiring lock "cinder-quobyte-59308b6b-a087-403a-aae3-b226f57141b2" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "cinder-quobyte-59308b6b-a087-403a-aae3-b226f57141b2" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d0d3b-c008-41b7-b042-489c4d3cc25a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:51:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:22 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2
Jul 31 14:51:22 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:22 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2" returned: 0 in 0.405s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:22 devstack sudo[92129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2
Jul 31 14:51:22 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:22 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59308b6b-a087-403a-aae3-b226f57141b2" returned: 0 in 0.338s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "cinder-quobyte-59308b6b-a087-403a-aae3-b226f57141b2" released by "delete_volume" :: held 0.850s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:22 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Created reservations ['5592700a-19da-4dea-8ee5-5871178f2ca0', 'ea5589c0-fd99-4a3a-ba68-e2ccc5530994', 'f98dbf9e-6348-42be-afca-5619a65cce53', '3e923dbc-e69a-4a00-9b69-9e4820ad367f'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:23 devstack sudo[92136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:51:23 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:23 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.589s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:51:23 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Deleted volume successfully.
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Flow 'volume_create_manager' (29517ff6-af46-49a4-8f05-1ced16f235c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479350f5-5d7b-4d89-9788-c0d7296cf8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479350f5-5d7b-4d89-9788-c0d7296cf8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1081550453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea41ef1-4868-4c18-ab64-b2ce636d9dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93265b41375e4b669e831b4cc05c9694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:24Z,use_quota=True,user_id='3d208569b99d4fc9a265c3a4f11a2303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956be89-125e-4fc5-9440-d35d7fb89879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956be89-125e-4fc5-9440-d35d7fb89879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc93b8c4-98a2-4bd4-989f-12e34bd288ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc93b8c4-98a2-4bd4-989f-12e34bd288ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea41ef1-4868-4c18-ab64-b2ce636d9dba', 'volume_name': 'volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae09a373-9187-47f6-aae1-024c3942164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae09a373-9187-47f6-aae1-024c3942164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0424fc3e-f115-4c56-baee-28b4ba107caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:24 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Volume bea41ef1-4868-4c18-ab64-b2ce636d9dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba', 'volume_size': 1}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1081550453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea41ef1-4868-4c18-ab64-b2ce636d9dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93265b41375e4b669e831b4cc05c9694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:24Z,use_quota=True,user_id='3d208569b99d4fc9a265c3a4f11a2303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Creating volume bea41ef1-4868-4c18-ab64-b2ce636d9dba {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:51:24 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6fac696f-3d7b-4e1f-a17a-b2aaa36a67a8 tempest-VolumeQuotasNegativeTestJSON-1104734081 None] Lock "cinder-59308b6b-a087-403a-aae3-b226f57141b2-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:24 devstack sudo[92139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba 1073741824
Jul 31 14:51:24 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:24 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba 1073741824" returned: 0 in 0.895s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:24 devstack sudo[92151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba
Jul 31 14:51:25 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:25 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba" returned: 0 in 0.305s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:51:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0424fc3e-f115-4c56-baee-28b4ba107caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be64dcd6-5b7c-481e-a412-e68fea2c8caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Volume volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba (bea41ef1-4868-4c18-ab64-b2ce636d9dba): created successfully
Jul 31 14:51:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be64dcd6-5b7c-481e-a412-e68fea2c8caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Flow 'volume_create_manager' (29517ff6-af46-49a4-8f05-1ced16f235c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5daea120-8efe-450d-9729-3fa9d0777996 tempest-AttachVolumeShelveTestJSON-1204524545 None] Created volume successfully.
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Flow 'volume_create_manager' (615f425b-6b42-41f4-8ca1-41fbec82119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ae0819-8671-4d1b-aed4-855cd1127c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ae0819-8671-4d1b-aed4-855cd1127c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-195365447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e26a1c-54b2-4ee8-b3bb-4da484711ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d9279984c540cda3638ed70c14e6eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:30Z,use_quota=True,user_id='675ace8bc00d4da7b7f69c3b71402424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5120c015-6e23-4a74-9529-fb6306700923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5120c015-6e23-4a74-9529-fb6306700923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1df6c9-390e-4b04-9ab5-a6601a4a9160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1df6c9-390e-4b04-9ab5-a6601a4a9160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e26a1c-54b2-4ee8-b3bb-4da484711ca2', 'volume_name': 'volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34ba1dc-76a8-4a93-a9d9-a8de54c7b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34ba1dc-76a8-4a93-a9d9-a8de54c7b847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1083e0d0-50eb-4120-a007-a76cc3b97eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Volume 49e26a1c-54b2-4ee8-b3bb-4da484711ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2', 'volume_size': 1}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-195365447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e26a1c-54b2-4ee8-b3bb-4da484711ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d9279984c540cda3638ed70c14e6eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:30Z,use_quota=True,user_id='675ace8bc00d4da7b7f69c3b71402424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Creating volume 49e26a1c-54b2-4ee8-b3bb-4da484711ca2 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:51:30 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:30 devstack sudo[92208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2 1073741824
Jul 31 14:51:30 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:30 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2 1073741824" returned: 0 in 0.652s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:31 devstack sudo[92214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2
Jul 31 14:51:31 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:31 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2" returned: 0 in 0.365s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:51:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1083e0d0-50eb-4120-a007-a76cc3b97eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1924f7a2-cf3c-4448-8c15-3c1560f9fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Volume volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2 (49e26a1c-54b2-4ee8-b3bb-4da484711ca2): created successfully
Jul 31 14:51:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1924f7a2-cf3c-4448-8c15-3c1560f9fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Flow 'volume_create_manager' (615f425b-6b42-41f4-8ca1-41fbec82119e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-887aeb8f-73e8-4c83-aad2-ba1f7032c0fd tempest-ServersNegativeTestJSON-361074486 None] Created volume successfully.
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Flow 'volume_create_manager' (f3f458e1-e309-4dc2-8c6b-9f606add79d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1247ef-8bd6-4e19-a254-a110be0d3d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1247ef-8bd6-4e19-a254-a110be0d3d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1533558520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0bd99c-9e1e-4596-a546-b2e114d1bda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bbde198bdc4c5b84394ca23e851fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:39Z,use_quota=True,user_id='5dd58bf72e6b43258d5fb181017c4c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2398ff4b-43a3-4353-a231-db7410f3a0c4),volume_type_id=2398ff4b-43a3-4353-a231-db7410f3a0c4)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6ee0c0-ff1a-4c9a-a12a-0fbc0d716ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6ee0c0-ff1a-4c9a-a12a-0fbc0d716ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2164ed8-d046-4731-b031-a0ff9bca68bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2164ed8-d046-4731-b031-a0ff9bca68bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0bd99c-9e1e-4596-a546-b2e114d1bda1', 'volume_name': 'volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11df7026-4915-4d8e-9964-d352b032ee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11df7026-4915-4d8e-9964-d352b032ee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b36f5e-0925-4755-8f58-4a14c61672e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Volume 7f0bd99c-9e1e-4596-a546-b2e114d1bda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1', 'volume_size': 1}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1533558520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0bd99c-9e1e-4596-a546-b2e114d1bda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bbde198bdc4c5b84394ca23e851fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:39Z,use_quota=True,user_id='5dd58bf72e6b43258d5fb181017c4c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2398ff4b-43a3-4353-a231-db7410f3a0c4),volume_type_id=2398ff4b-43a3-4353-a231-db7410f3a0c4)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Creating volume 7f0bd99c-9e1e-4596-a546-b2e114d1bda1 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:51:39 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:39 devstack sudo[92236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1 1073741824
Jul 31 14:51:39 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:39 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1 1073741824" returned: 0 in 0.658s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:39 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1
Jul 31 14:51:39 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Flow 'volume_create_manager' (2776b883-580e-41d4-986f-8b16fcf493f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1080af63-3b34-4f29-9db8-1b7f5798a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1080af63-3b34-4f29-9db8-1b7f5798a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-606250047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f28896c-10d7-4d43-99d3-0f84b184ffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d9279984c540cda3638ed70c14e6eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:40Z,use_quota=True,user_id='675ace8bc00d4da7b7f69c3b71402424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a0031c-e36c-452a-9567-e663d9ea36ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a0031c-e36c-452a-9567-e663d9ea36ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d686dd-1424-4741-92f3-ebe550f61ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d686dd-1424-4741-92f3-ebe550f61ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f28896c-10d7-4d43-99d3-0f84b184ffde', 'volume_name': 'volume-5f28896c-10d7-4d43-99d3-0f84b184ffde', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5840de4d-6d06-44e9-9f79-795c5c2b00fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5840de4d-6d06-44e9-9f79-795c5c2b00fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee647f54-6b1f-4d6e-9a7b-a296d380c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Volume 5f28896c-10d7-4d43-99d3-0f84b184ffde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f28896c-10d7-4d43-99d3-0f84b184ffde', 'volume_size': 1}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:40 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1" returned: 0 in 0.313s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-606250047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f28896c-10d7-4d43-99d3-0f84b184ffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d9279984c540cda3638ed70c14e6eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:40Z,use_quota=True,user_id='675ace8bc00d4da7b7f69c3b71402424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Creating volume 5f28896c-10d7-4d43-99d3-0f84b184ffde {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:51:40 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b36f5e-0925-4755-8f58-4a14c61672e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24fb763-5870-4d43-b766-959dae94dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:40 devstack sudo[92254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde 1073741824
Jul 31 14:51:40 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Volume volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1 (7f0bd99c-9e1e-4596-a546-b2e114d1bda1): created successfully
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24fb763-5870-4d43-b766-959dae94dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Flow 'volume_create_manager' (f3f458e1-e309-4dc2-8c6b-9f606add79d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-de76588d-1d0f-41a3-85bb-44f14a79acf4 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Created volume successfully.
Jul 31 14:51:40 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde 1073741824" returned: 0 in 0.736s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:40 devstack sudo[92276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde
Jul 31 14:51:40 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:41 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde" returned: 0 in 0.379s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee647f54-6b1f-4d6e-9a7b-a296d380c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f28896c-10d7-4d43-99d3-0f84b184ffde', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1064de79-5b2b-49c5-b547-968025376e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:41 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Volume volume-5f28896c-10d7-4d43-99d3-0f84b184ffde (5f28896c-10d7-4d43-99d3-0f84b184ffde): created successfully
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1064de79-5b2b-49c5-b547-968025376e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Flow 'volume_create_manager' (2776b883-580e-41d4-986f-8b16fcf493f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-18d990c7-7e17-4112-9b9d-d735d8596819 tempest-ServersNegativeTestJSON-361074486 None] Created volume successfully.
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:41 devstack sudo[92281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:51:41 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:41 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.358s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:41 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:51:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-32e44efe-2730-4daa-98c4-92e320315ff6 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Retype volume completed successfully.
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Acquiring lock "cinder-7f0bd99c-9e1e-4596-a546-b2e114d1bda1-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "cinder-7f0bd99c-9e1e-4596-a546-b2e114d1bda1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "cinder-5f28896c-10d7-4d43-99d3-0f84b184ffde-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-5f28896c-10d7-4d43-99d3-0f84b184ffde-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-00ad1af6-1228-484b-8b24-6968d14c5702 req-0998102e-04bd-458a-868d-a58f801f10a2 tempest-AttachVolumeShelveTestJSON-1204524545 None] No connector for attachment 6c0488c4-3b8f-4119-b440-4e8a81310c1a; skipping storage backend terminate_connection call. {{(pid=88594) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-00ad1af6-1228-484b-8b24-6968d14c5702 req-0998102e-04bd-458a-868d-a58f801f10a2 tempest-AttachVolumeShelveTestJSON-1204524545 None] Deleting attachment 6c0488c4-3b8f-4119-b440-4e8a81310c1a. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Acquiring lock "cinder-quobyte-7f0bd99c-9e1e-4596-a546-b2e114d1bda1" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "cinder-quobyte-5f28896c-10d7-4d43-99d3-0f84b184ffde" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "cinder-quobyte-7f0bd99c-9e1e-4596-a546-b2e114d1bda1" acquired by "delete_volume" :: waited 0.041s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[92591ddc-e23d-46e2-8e85-5c04b8c9ccef]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-quobyte-5f28896c-10d7-4d43-99d3-0f84b184ffde" acquired by "delete_volume" :: waited 0.065s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7950d-39be-4c26-8aed-249714fb1896]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:43 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1
Jul 31 14:51:43 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:43 devstack sudo[92348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde
Jul 31 14:51:43 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:43 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1" returned: 0 in 0.557s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:43 devstack sudo[92378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1
Jul 31 14:51:43 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:43 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde" returned: 0 in 0.566s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:43 devstack sudo[92380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde
Jul 31 14:51:43 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:44 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0bd99c-9e1e-4596-a546-b2e114d1bda1" returned: 0 in 0.342s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "cinder-quobyte-7f0bd99c-9e1e-4596-a546-b2e114d1bda1" released by "delete_volume" :: held 0.963s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:44 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f28896c-10d7-4d43-99d3-0f84b184ffde" returned: 0 in 0.339s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:44 devstack cinder-volume[88594]: WARNING cinder.quota [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:51:44 devstack cinder-volume[88594]: WARNING cinder.quota [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-quobyte-5f28896c-10d7-4d43-99d3-0f84b184ffde" released by "delete_volume" :: held 0.979s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Created reservations ['c9ea733b-fb8a-4e27-a930-1963caf30e57', '2be97205-d4cc-4124-b410-f54707a99e43', '0822828f-3660-402d-88fe-591c3b23277d', '9e483f6f-2765-4af7-bbde-0eb7a67ca926'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Created reservations ['7f2ed363-1b70-4739-a4af-a36d9207348e', 'c831b347-e030-4124-a4ea-2f4198247dc3', '8db1c629-2c0c-4722-a3a7-18cc51da375c', '7bb4324f-078d-4328-9f13-77f566cb5e4c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:44 devstack sudo[92384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:51:44 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:44 devstack sudo[92386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:51:44 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:44 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.294s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:51:44 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Deleted volume successfully.
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d8b8e436-1c53-4fdb-b5bd-0d693796e711 tempest-VolumeRetypeWithoutMigrationTest-396482867 None] Lock "cinder-7f0bd99c-9e1e-4596-a546-b2e114d1bda1-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:44 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.333s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:51:44 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Deleted volume successfully.
Jul 31 14:51:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e7e39afb-73d7-4088-9249-ef29fa5afaff tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-5f28896c-10d7-4d43-99d3-0f84b184ffde-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "cinder-49e26a1c-54b2-4ee8-b3bb-4da484711ca2-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-49e26a1c-54b2-4ee8-b3bb-4da484711ca2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "cinder-quobyte-49e26a1c-54b2-4ee8-b3bb-4da484711ca2" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-quobyte-49e26a1c-54b2-4ee8-b3bb-4da484711ca2" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:45 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[988c310b-0f6f-4da0-8fd4-b4d0afa527fd]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:51:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:45 devstack sudo[92397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2
Jul 31 14:51:45 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:46 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2" returned: 0 in 0.657s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:46 devstack sudo[92403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2
Jul 31 14:51:46 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:46 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-49e26a1c-54b2-4ee8-b3bb-4da484711ca2" returned: 0 in 0.412s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-quobyte-49e26a1c-54b2-4ee8-b3bb-4da484711ca2" released by "delete_volume" :: held 1.152s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Created reservations ['5a0c6fa8-24a6-482e-8f1d-0d5f75d2035d', 'c621310f-d6b6-4732-8e0b-d0c759fce335', 'b093d14b-80a7-497d-9c8b-4aeece4c2eeb', 'e256d539-f8cd-4c46-a902-e2090af64fc6'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:47 devstack sudo[92406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:51:47 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:47 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.388s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:51:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Deleted volume successfully.
Jul 31 14:51:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70f094b6-5e34-41c4-8767-beb833a47c74 tempest-ServersNegativeTestJSON-361074486 None] Lock "cinder-49e26a1c-54b2-4ee8-b3bb-4da484711ca2-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Flow 'volume_create_manager' (018fc9a4-5f6a-41c3-9daa-0c61fdd2d4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5bab97-85a3-4f6f-aabe-7473b06fc93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5bab97-85a3-4f6f-aabe-7473b06fc93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-7720288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf1c4b3-632b-4758-b640-38479d5a1f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe9e8a7a9f954c9287acf085780ea357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:57Z,use_quota=True,user_id='14447649cf9e49f1925715c060a27c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f61d0a1-90a9-4310-9faf-77de3802ff41),volume_type_id=9f61d0a1-90a9-4310-9faf-77de3802ff41)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14c863b-f632-408c-940b-4ac83a1aa638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14c863b-f632-408c-940b-4ac83a1aa638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced820f8-79e3-449b-a685-1cd3bb3fa8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced820f8-79e3-449b-a685-1cd3bb3fa8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf1c4b3-632b-4758-b640-38479d5a1f46', 'volume_name': 'volume-edf1c4b3-632b-4758-b640-38479d5a1f46', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7c92f2-b68c-41e6-aa28-a809562f03b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7c92f2-b68c-41e6-aa28-a809562f03b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ce6ec-67ac-419d-b717-b66d230c83f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Volume edf1c4b3-632b-4758-b640-38479d5a1f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf1c4b3-632b-4758-b640-38479d5a1f46', 'volume_size': 1}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-7720288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf1c4b3-632b-4758-b640-38479d5a1f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe9e8a7a9f954c9287acf085780ea357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:51:57Z,use_quota=True,user_id='14447649cf9e49f1925715c060a27c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f61d0a1-90a9-4310-9faf-77de3802ff41),volume_type_id=9f61d0a1-90a9-4310-9faf-77de3802ff41)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Creating volume edf1c4b3-632b-4758-b640-38479d5a1f46 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:51:57 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:57 devstack sudo[92479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46 1073741824
Jul 31 14:51:57 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 8 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:51:57 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46 1073741824" returned: 0 in 0.837s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:58 devstack sudo[92507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46
Jul 31 14:51:58 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:58 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46" returned: 0 in 0.577s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ce6ec-67ac-419d-b717-b66d230c83f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf1c4b3-632b-4758-b640-38479d5a1f46', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9104c14-4e30-4354-92e9-d5e4c8ef0182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:51:58 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Volume volume-edf1c4b3-632b-4758-b640-38479d5a1f46 (edf1c4b3-632b-4758-b640-38479d5a1f46): created successfully
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9104c14-4e30-4354-92e9-d5e4c8ef0182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:51:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Flow 'volume_create_manager' (018fc9a4-5f6a-41c3-9daa-0c61fdd2d4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:51:58 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4e6c93e1-ea56-49c2-8fe5-bd5499d50f87 tempest-VolumeTypesAccessTest-1838689693 None] Created volume successfully.
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Acquiring lock "cinder-edf1c4b3-632b-4758-b640-38479d5a1f46-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Lock "cinder-edf1c4b3-632b-4758-b640-38479d5a1f46-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Acquiring lock "cinder-quobyte-edf1c4b3-632b-4758-b640-38479d5a1f46" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Lock "cinder-quobyte-edf1c4b3-632b-4758-b640-38479d5a1f46" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b14f26a-1070-4641-ab45-bd7127ef439a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:51:59 devstack sudo[92584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46
Jul 31 14:51:59 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:51:59 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46" returned: 0 in 0.413s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:51:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:00 devstack sudo[92606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46
Jul 31 14:52:00 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:00 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-edf1c4b3-632b-4758-b640-38479d5a1f46" returned: 0 in 0.274s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Lock "cinder-quobyte-edf1c4b3-632b-4758-b640-38479d5a1f46" released by "delete_volume" :: held 0.731s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:00 devstack cinder-volume[88594]: WARNING cinder.quota [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1382710545 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1382710545, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:52:00 devstack cinder-volume[88594]: WARNING cinder.quota [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1382710545 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1382710545, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Created reservations ['16d46cb3-0496-4e41-b2bb-71b750e15453', 'c1dad9a5-6103-464e-8d11-816061fabe96', 'f670789c-3528-4b4f-b750-14d33a979917', 'c5a3f958-7366-478c-ab05-791710f12c9c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:00 devstack sudo[92609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:00 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:00 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.357s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Deleted volume successfully.
Jul 31 14:52:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-96620896-e583-4176-a2ac-a943e8bcc788 tempest-VolumeTypesAccessTest-1838689693 None] Lock "cinder-edf1c4b3-632b-4758-b640-38479d5a1f46-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Flow 'volume_create_manager' (e243f31e-f2bf-4931-86a7-4d47b65a7ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a654b58-3b66-405b-aa5e-8ebdbf48e939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a654b58-3b66-405b-aa5e-8ebdbf48e939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1317274751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a26d5b-0651-4295-94db-c8841c9f8a4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17651e876f734de595de279117d64eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:03Z,use_quota=True,user_id='db5bb97aa59e45f495da35d444619003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c99ee67-d424-4f6c-a6a8-bda8234b017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c99ee67-d424-4f6c-a6a8-bda8234b017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7314f0-d3fb-44e1-9bfb-a94c839fed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7314f0-d3fb-44e1-9bfb-a94c839fed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a26d5b-0651-4295-94db-c8841c9f8a4f', 'volume_name': 'volume-08a26d5b-0651-4295-94db-c8841c9f8a4f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042c88fc-cd44-4ce1-986f-620b1056b7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042c88fc-cd44-4ce1-986f-620b1056b7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47469a5-1e5c-48e1-983f-f9855f676a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:03 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Volume 08a26d5b-0651-4295-94db-c8841c9f8a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a26d5b-0651-4295-94db-c8841c9f8a4f', 'volume_size': 1}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1317274751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a26d5b-0651-4295-94db-c8841c9f8a4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17651e876f734de595de279117d64eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:03Z,use_quota=True,user_id='db5bb97aa59e45f495da35d444619003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Creating volume 08a26d5b-0651-4295-94db-c8841c9f8a4f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:03 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:03 devstack sudo[92616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f 1073741824
Jul 31 14:52:03 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:04 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f 1073741824" returned: 0 in 0.749s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:04 devstack sudo[92621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f
Jul 31 14:52:04 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:04 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f" returned: 0 in 0.303s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47469a5-1e5c-48e1-983f-f9855f676a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a26d5b-0651-4295-94db-c8841c9f8a4f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fafb94-365b-4394-976c-17ceb4a45923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:04 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Volume volume-08a26d5b-0651-4295-94db-c8841c9f8a4f (08a26d5b-0651-4295-94db-c8841c9f8a4f): created successfully
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fafb94-365b-4394-976c-17ceb4a45923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Flow 'volume_create_manager' (e243f31e-f2bf-4931-86a7-4d47b65a7ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-a8b51e6a-2df4-4723-b0cb-001342134969 req-8c3928f1-93f2-4775-8a8c-c92cbe2d9806 tempest-VolumesGetTestJSON-359316171 None] Created volume successfully.
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Acquiring lock "cinder-08a26d5b-0651-4295-94db-c8841c9f8a4f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Lock "cinder-08a26d5b-0651-4295-94db-c8841c9f8a4f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Acquiring lock "cinder-quobyte-08a26d5b-0651-4295-94db-c8841c9f8a4f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Lock "cinder-quobyte-08a26d5b-0651-4295-94db-c8841c9f8a4f" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[934e5686-390f-4325-9dc9-4b66e86a8093]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:06 devstack sudo[92634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f
Jul 31 14:52:06 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:06 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f" returned: 0 in 0.396s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:06 devstack sudo[92663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f
Jul 31 14:52:06 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:06 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08a26d5b-0651-4295-94db-c8841c9f8a4f" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Lock "cinder-quobyte-08a26d5b-0651-4295-94db-c8841c9f8a4f" released by "delete_volume" :: held 0.741s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:06 devstack cinder-volume[88594]: DEBUG cinder.quota [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Created reservations ['846845f7-2f56-454c-96fe-ecf050657a65', 'a7bd3f2e-c551-4a69-9ff8-6bdd0a6086f8', '02295865-52d5-4ef3-88fc-687845d23936', '5c1b3b4e-97bc-41da-8c62-8eada28faac9'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:07 devstack sudo[92668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:07 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:07 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG cinder.manager [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:07 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Deleted volume successfully.
Jul 31 14:52:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2d49edc1-5c35-4406-a287-ac7c3ae6bae4 req-baedc6fb-dcc9-4680-8409-09be3e1e3365 tempest-VolumesGetTestJSON-359316171 None] Lock "cinder-08a26d5b-0651-4295-94db-c8841c9f8a4f-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Flow 'volume_create_manager' (9307ba78-5a0f-46af-aad6-5e48e2e2a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6491ac-f4c0-49b1-9041-c05bf03ad7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6491ac-f4c0-49b1-9041-c05bf03ad7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1016086752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df786180-99cf-4128-b091-c539173c3d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e0bd9e97764816980daea7784da3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:10Z,use_quota=True,user_id='7cab16517f75400cacd0e0608158106a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226081e9-53e8-4764-9de0-6030406e51e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226081e9-53e8-4764-9de0-6030406e51e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7e6cca-ce1c-435f-873c-3a632097fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7e6cca-ce1c-435f-873c-3a632097fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df786180-99cf-4128-b091-c539173c3d03', 'volume_name': 'volume-df786180-99cf-4128-b091-c539173c3d03', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820630f1-35b8-4477-8d44-0715da708343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820630f1-35b8-4477-8d44-0715da708343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26aa306-7be3-476e-9a38-f66d9fbfcb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Volume df786180-99cf-4128-b091-c539173c3d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df786180-99cf-4128-b091-c539173c3d03', 'volume_size': 1}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1016086752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df786180-99cf-4128-b091-c539173c3d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e0bd9e97764816980daea7784da3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:10Z,use_quota=True,user_id='7cab16517f75400cacd0e0608158106a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Creating volume df786180-99cf-4128-b091-c539173c3d03 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:10 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:10 devstack sudo[92674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03 1073741824
Jul 31 14:52:10 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:11 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03 1073741824" returned: 0 in 0.715s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:11 devstack sudo[92681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03
Jul 31 14:52:11 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:11 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03" returned: 0 in 0.471s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26aa306-7be3-476e-9a38-f66d9fbfcb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df786180-99cf-4128-b091-c539173c3d03', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e8554-dfd4-4d22-a68d-e00bb13f05d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Volume volume-df786180-99cf-4128-b091-c539173c3d03 (df786180-99cf-4128-b091-c539173c3d03): created successfully
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e8554-dfd4-4d22-a68d-e00bb13f05d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Flow 'volume_create_manager' (9307ba78-5a0f-46af-aad6-5e48e2e2a99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3c6e1c95-f572-4638-b42a-5ab4a0bb5726 tempest-ServerActionsTestOtherA-493789991 None] Created volume successfully.
Jul 31 14:52:13 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=51,cinder:UPDATE=76,cinder:INSERT=15,cinder:DELETE=9 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:52:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-26ff1990-82aa-4075-9817-e991fe12b644 tempest-GroupsV320Test-111246006 None] Group tempest-GroupsV320Test-Group-1037779586: creating
Jul 31 14:52:13 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=60,cinder:UPDATE=78,cinder:DELETE=5,cinder:INSERT=17 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:52:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-26ff1990-82aa-4075-9817-e991fe12b644 tempest-GroupsV320Test-111246006 None] Group tempest-GroupsV320Test-Group-1037779586: created successfully
Jul 31 14:52:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-26ff1990-82aa-4075-9817-e991fe12b644 tempest-GroupsV320Test-111246006 None] Create group completed successfully.
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Created reservations ['c8a5f75f-6b0e-49a5-96e1-b650414f3ab1'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:15 devstack sudo[92694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:15 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:15 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:15 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:15 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9e3c0df4-b7c8-4860-8440-d65984f4bbbb tempest-GroupsV320Test-111246006 None] Delete group completed successfully.
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Flow 'volume_create_manager' (d1e24f6e-aa9a-457b-b214-24ee059513c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d1c7b-01d3-4f1b-b413-3301e8038479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d1c7b-01d3-4f1b-b413-3301e8038479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-777931723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d6db23-331e-4bf4-a3ad-1504c0ca4c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54846a49d92d4c84979c1d2a9e2c8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:16Z,use_quota=True,user_id='55a2606af696495188021b97ce070a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d134d00-16b3-4abb-b2c6-d4aadd40f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d134d00-16b3-4abb-b2c6-d4aadd40f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2462eb79-1be9-4d53-868e-f3b42cf05987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2462eb79-1be9-4d53-868e-f3b42cf05987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d6db23-331e-4bf4-a3ad-1504c0ca4c76', 'volume_name': 'volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29230d99-9c24-485b-bb96-6f82d2d43b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29230d99-9c24-485b-bb96-6f82d2d43b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a47bf4a-17e7-4f1c-9c64-392c275371c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:16 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Volume b9d6db23-331e-4bf4-a3ad-1504c0ca4c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76', 'volume_size': 1}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-777931723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d6db23-331e-4bf4-a3ad-1504c0ca4c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54846a49d92d4c84979c1d2a9e2c8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:16Z,use_quota=True,user_id='55a2606af696495188021b97ce070a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Creating volume b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:16 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:16 devstack sudo[92701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 1073741824
Jul 31 14:52:16 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:16 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 1073741824" returned: 0 in 0.577s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:16 devstack sudo[92720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76
Jul 31 14:52:16 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:17 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76" returned: 0 in 0.350s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a47bf4a-17e7-4f1c-9c64-392c275371c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddb48b5-38e3-4e46-877b-4204280cbaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:17 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Volume volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 (b9d6db23-331e-4bf4-a3ad-1504c0ca4c76): created successfully
Jul 31 14:52:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddb48b5-38e3-4e46-877b-4204280cbaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Flow 'volume_create_manager' (d1e24f6e-aa9a-457b-b214-24ee059513c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f4613776-5c98-4cba-b680-3e2124a6d411 tempest-VolumesListAdminTestJSON-1971360389 None] Created volume successfully.
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Flow 'volume_create_manager' (fb869711-c396-4f2c-8c18-b531fe96d685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c6d37-d63e-4f0a-9783-f7a5f9fa87bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c6d37-d63e-4f0a-9783-f7a5f9fa87bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-209401702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ece6c3-bfdb-44c7-b126-f4b90e27dce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54846a49d92d4c84979c1d2a9e2c8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:19Z,use_quota=True,user_id='55a2606af696495188021b97ce070a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a7d9f7-9c1f-442a-b3b6-149bf215a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a7d9f7-9c1f-442a-b3b6-149bf215a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ab1fe8-5195-48f2-9f47-92d54384fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ab1fe8-5195-48f2-9f47-92d54384fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ece6c3-bfdb-44c7-b126-f4b90e27dce1', 'volume_name': 'volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f767eec-a9ad-478c-a911-2d8e05e1fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f767eec-a9ad-478c-a911-2d8e05e1fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfe48a9-b34b-47e7-be3c-924e1238261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:19 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Volume b3ece6c3-bfdb-44c7-b126-f4b90e27dce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1', 'volume_size': 1}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-209401702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ece6c3-bfdb-44c7-b126-f4b90e27dce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54846a49d92d4c84979c1d2a9e2c8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:19Z,use_quota=True,user_id='55a2606af696495188021b97ce070a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Creating volume b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:19 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:19 devstack sudo[92755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 1073741824
Jul 31 14:52:19 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:19 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 1073741824" returned: 0 in 0.565s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:19 devstack sudo[92778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1
Jul 31 14:52:19 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:20 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1" returned: 0 in 0.353s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfe48a9-b34b-47e7-be3c-924e1238261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59884dbb-7c9a-4329-9d93-11ef2549fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:20 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Volume volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 (b3ece6c3-bfdb-44c7-b126-f4b90e27dce1): created successfully
Jul 31 14:52:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59884dbb-7c9a-4329-9d93-11ef2549fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Flow 'volume_create_manager' (fb869711-c396-4f2c-8c18-b531fe96d685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7a102959-6620-461f-a0be-8834fdae538e tempest-VolumesListAdminTestJSON-1971360389 None] Created volume successfully.
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Flow 'volume_create_manager' (c9c993d5-271a-4502-ad3b-b579aa738399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2fb0db-26d4-4b46-bc70-d6136f0ebca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2fb0db-26d4-4b46-bc70-d6136f0ebca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1196031938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9918051f-07dc-486f-b5ea-a8ac6596b545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54846a49d92d4c84979c1d2a9e2c8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:22Z,use_quota=True,user_id='55a2606af696495188021b97ce070a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5d704-e35b-4828-af9a-4bdfb5bdbf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5d704-e35b-4828-af9a-4bdfb5bdbf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a5835c-e667-4fa7-9943-0a43b259499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a5835c-e667-4fa7-9943-0a43b259499a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9918051f-07dc-486f-b5ea-a8ac6596b545', 'volume_name': 'volume-9918051f-07dc-486f-b5ea-a8ac6596b545', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5feeb04-cb6f-4a38-a3ce-e5718c45bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5feeb04-cb6f-4a38-a3ce-e5718c45bfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cfe68e-0239-4db9-9bd6-c733adbb2b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:22 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Volume 9918051f-07dc-486f-b5ea-a8ac6596b545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9918051f-07dc-486f-b5ea-a8ac6596b545', 'volume_size': 1}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1196031938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9918051f-07dc-486f-b5ea-a8ac6596b545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54846a49d92d4c84979c1d2a9e2c8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:22Z,use_quota=True,user_id='55a2606af696495188021b97ce070a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Creating volume 9918051f-07dc-486f-b5ea-a8ac6596b545 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:22 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:22 devstack sudo[92796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545 1073741824
Jul 31 14:52:22 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:23 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545 1073741824" returned: 0 in 0.609s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:23 devstack sudo[92801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545
Jul 31 14:52:23 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:23 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545" returned: 0 in 0.459s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cfe68e-0239-4db9-9bd6-c733adbb2b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9918051f-07dc-486f-b5ea-a8ac6596b545', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f7b2d8-90bf-411c-a325-c9b8e1ae26a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Volume volume-9918051f-07dc-486f-b5ea-a8ac6596b545 (9918051f-07dc-486f-b5ea-a8ac6596b545): created successfully
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f7b2d8-90bf-411c-a325-c9b8e1ae26a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Flow 'volume_create_manager' (c9c993d5-271a-4502-ad3b-b579aa738399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Flow 'volume_create_manager' (7a22aa1b-7d05-4ba9-8bf1-5ad9747de43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b435b5-4ea8-4840-8c46-8d08692d058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:23 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-56a6f2ee-d13b-4dfe-85d3-91e2b8ef2d72 tempest-VolumesListAdminTestJSON-1971360389 None] Created volume successfully.
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b435b5-4ea8-4840-8c46-8d08692d058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-949842569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2363d576-fcbd-4c30-9fd2-35f4305fdae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f2f07bd1f040abbca8b1d7c91ab9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:24Z,use_quota=True,user_id='9a8fcff24ded45c19d6b4bee3dfad392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f780071-61c0-40e8-9ac1-e56e2f59a1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f780071-61c0-40e8-9ac1-e56e2f59a1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb01449c-8af9-4ef3-823f-2b3bb10f4af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb01449c-8af9-4ef3-823f-2b3bb10f4af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2363d576-fcbd-4c30-9fd2-35f4305fdae9', 'volume_name': 'volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992789db-d646-44a7-bc37-4323a618e026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992789db-d646-44a7-bc37-4323a618e026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac960cbc-0525-489b-9b10-46d55e14467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9', 'volume_size': 1}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-949842569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2363d576-fcbd-4c30-9fd2-35f4305fdae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f2f07bd1f040abbca8b1d7c91ab9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:24Z,use_quota=True,user_id='9a8fcff24ded45c19d6b4bee3dfad392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Creating volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:23 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:23 devstack sudo[92804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 1073741824
Jul 31 14:52:23 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:24 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 1073741824" returned: 0 in 0.618s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:24 devstack sudo[92817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9
Jul 31 14:52:24 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:24 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9" returned: 0 in 0.389s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac960cbc-0525-489b-9b10-46d55e14467d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6735c-65cd-489e-b117-1a837b800e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Volume volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 (2363d576-fcbd-4c30-9fd2-35f4305fdae9): created successfully
Jul 31 14:52:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6735c-65cd-489e-b117-1a837b800e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Flow 'volume_create_manager' (7a22aa1b-7d05-4ba9-8bf1-5ad9747de43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4e6d002d-8b93-436c-ba23-c1e0cc7e587c tempest-SnapshotsActionsTest-1312333747 None] Created volume successfully.
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Flow 'volume_create_manager' (64cc19d7-42ba-4e3b-b27b-4d3bc983b6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37937f3-888c-4fc5-a614-5cdf658a25e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37937f3-888c-4fc5-a614-5cdf658a25e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b22b64-743a-412b-b1f2-2e440124b0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708abd28b98a4eaeaf2d4d6ce7ff36f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:26Z,use_quota=True,user_id='7b84efe899a34d84919559cea8b45d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb76953-2350-4e47-81d1-d0436b2db6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb76953-2350-4e47-81d1-d0436b2db6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42dea27-e27a-4377-afbb-600c2fd791ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42dea27-e27a-4377-afbb-600c2fd791ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b22b64-743a-412b-b1f2-2e440124b0ab', 'volume_name': 'volume-79b22b64-743a-412b-b1f2-2e440124b0ab', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e311103-521f-4b3e-8d03-2416d45675f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e311103-521f-4b3e-8d03-2416d45675f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89a8143-c905-494f-be97-784381195264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:26 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Volume 79b22b64-743a-412b-b1f2-2e440124b0ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b22b64-743a-412b-b1f2-2e440124b0ab', 'volume_size': 1}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b22b64-743a-412b-b1f2-2e440124b0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708abd28b98a4eaeaf2d4d6ce7ff36f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:26Z,use_quota=True,user_id='7b84efe899a34d84919559cea8b45d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Creating volume 79b22b64-743a-412b-b1f2-2e440124b0ab {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:26 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:26 devstack sudo[92850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab 1073741824
Jul 31 14:52:26 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:26 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab 1073741824" returned: 0 in 0.666s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:26 devstack sudo[92857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab
Jul 31 14:52:26 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:27 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab" returned: 0 in 0.256s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.768s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Creating offline snapshot dd4f74f1-d69b-415d-97ef-fa0c63425c85 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89a8143-c905-494f-be97-784381195264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b22b64-743a-412b-b1f2-2e440124b0ab', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac0e19c-c0b6-4965-a6d1-8a69e4bd2169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e890d1d-b517-457c-b46f-4c00192f0c09]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:27 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Volume volume-79b22b64-743a-412b-b1f2-2e440124b0ab (79b22b64-743a-412b-b1f2-2e440124b0ab): created successfully
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac0e19c-c0b6-4965-a6d1-8a69e4bd2169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Flow 'volume_create_manager' (64cc19d7-42ba-4e3b-b27b-4d3bc983b6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d5417b09-6f60-4f53-ace6-2a9bb0a1d4e1 tempest-VolumesListAdminTestJSON-810477749 None] Created volume successfully.
Jul 31 14:52:27 devstack sudo[92861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9
Jul 31 14:52:27 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:27 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9" returned: 0 in 0.450s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:27 devstack sudo[92867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 1G
Jul 31 14:52:27 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Acquiring lock "cinder-79b22b64-743a-412b-b1f2-2e440124b0ab-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Lock "cinder-79b22b64-743a-412b-b1f2-2e440124b0ab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Acquiring lock "cinder-quobyte-79b22b64-743a-412b-b1f2-2e440124b0ab" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:28 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 1G" returned: 0 in 0.626s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Lock "cinder-quobyte-79b22b64-743a-412b-b1f2-2e440124b0ab" acquired by "delete_volume" :: waited 0.062s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:28 devstack sudo[92874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:28 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "cinder-9918051f-07dc-486f-b5ea-a8ac6596b545-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2cef1d-99d5-472d-99c0-ab96c6cef035]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-9918051f-07dc-486f-b5ea-a8ac6596b545-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "cinder-quobyte-9918051f-07dc-486f-b5ea-a8ac6596b545" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-quobyte-9918051f-07dc-486f-b5ea-a8ac6596b545" acquired by "delete_volume" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:28 devstack sudo[92876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab
Jul 31 14:52:28 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16aa63f-afc7-4d0f-afc8-06a81f889a27]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:28 devstack sudo[92879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545
Jul 31 14:52:28 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:28 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.583s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:28 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 is being set with open permissions: ugo+rw
Jul 31 14:52:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:28 devstack sudo[92885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:28 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:29 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab" returned: 0 in 0.569s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:29 devstack sudo[92890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab
Jul 31 14:52:29 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:29 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545" returned: 0 in 0.486s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:29 devstack sudo[92895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545
Jul 31 14:52:29 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:29 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.396s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:29 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-79b22b64-743a-412b-b1f2-2e440124b0ab" returned: 0 in 0.434s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:29 devstack sudo[92899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.info
Jul 31 14:52:29 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Lock "cinder-quobyte-79b22b64-743a-412b-b1f2-2e440124b0ab" released by "delete_volume" :: held 1.142s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Created reservations ['e873099c-945c-41c6-af4d-1694a6282fd3', '8639c2a4-ebd5-442d-8a18-c89b518aa810', 'acac6b7d-75c7-4d1a-9165-c90fc0f6de97', 'b712b671-0e71-4c21-9c41-ac5b0551acef'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:29 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9918051f-07dc-486f-b5ea-a8ac6596b545" returned: 0 in 0.486s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-quobyte-9918051f-07dc-486f-b5ea-a8ac6596b545" released by "delete_volume" :: held 1.040s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Created reservations ['6c59d2ee-f4b6-4d97-b6d2-0b17b6c81f15', 'f813d5ff-6e1b-4403-9fee-763e5a6bbcdc', 'b4a654f9-6a0f-4c31-9fb8-d9bd308da589', 'a82a46db-bb22-4693-83e1-c6d3233f8048'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:29 devstack sudo[92902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:29 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:29 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.info" returned: 0 in 0.543s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:29 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.info is being set with open permissions: ugo+rw
Jul 31 14:52:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:30 devstack sudo[92905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:30 devstack sudo[92906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.info
Jul 31 14:52:30 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:30 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:30 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.385s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Deleted volume successfully.
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-81f10427-0a91-4173-b401-d8d60b8e28e4 tempest-VolumesListAdminTestJSON-810477749 None] Lock "cinder-79b22b64-743a-412b-b1f2-2e440124b0ab-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:30 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.info" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:30 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.173s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.398s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Deleted volume successfully.
Jul 31 14:52:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8c84123f-db49-4952-a76a-8d5feea22e34 tempest-SnapshotsActionsTest-1312333747 None] Create snapshot completed successfully
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-108aa654-493f-46f6-bfc7-b45105dd66c1 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-9918051f-07dc-486f-b5ea-a8ac6596b545-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Acquiring lock "cinder-bea41ef1-4868-4c18-ab64-b2ce636d9dba-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "cinder-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "cinder-bea41ef1-4868-4c18-ab64-b2ce636d9dba-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Acquiring lock "cinder-quobyte-bea41ef1-4868-4c18-ab64-b2ce636d9dba" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "cinder-quobyte-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "cinder-quobyte-bea41ef1-4868-4c18-ab64-b2ce636d9dba" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-quobyte-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1" acquired by "delete_volume" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba68467c-3637-4c5e-9d9d-4f5499f01545]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[434db389-b6ed-48f6-9f72-b72ceff3471e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:31 devstack sudo[92913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba
Jul 31 14:52:31 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:31 devstack sudo[92914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1
Jul 31 14:52:31 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Creating offline snapshot 0395104e-e77a-49bc-b30b-834af02566b3 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9923dc7-5ff9-4615-86e1-360a9fe26c27]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:31 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba" returned: 0 in 0.461s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:31 devstack sudo[92921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba
Jul 31 14:52:31 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:31 devstack sudo[92920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:31 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:31 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1" returned: 0 in 0.554s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:31 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1
Jul 31 14:52:31 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:31 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-bea41ef1-4868-4c18-ab64-b2ce636d9dba" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "cinder-quobyte-bea41ef1-4868-4c18-ab64-b2ce636d9dba" released by "delete_volume" :: held 0.792s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Created reservations ['1d60bd18-62f3-4ab8-ab9c-3c77ee6bc019', '4642cc0d-c531-4112-a485-8a0509a903bc', 'a724ca4b-9aa8-4153-b98c-539cbd3ca8a1', '5b687eee-7811-48f7-841c-b9fc1cf35329'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:31 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.436s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:31 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:31 devstack sudo[92936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 1G
Jul 31 14:52:31 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1" returned: 0 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-quobyte-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1" released by "delete_volume" :: held 1.004s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:31 devstack sudo[92938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:31 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Created reservations ['9fce91e9-ecec-43f5-a8e3-16931edbf422', '21ffd869-5bf5-4e5b-88d4-4c50683ea691', '372f5fa8-bee0-4d6c-ad48-fee3b05dce1d', '1623e62a-3b2d-41a0-854b-731dd5604b77'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:32 devstack sudo[92940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:32 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:32 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Deleted volume successfully.
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c103dff3-f1f4-4573-831c-e5025952e9a5 tempest-AttachVolumeShelveTestJSON-1204524545 None] Lock "cinder-bea41ef1-4868-4c18-ab64-b2ce636d9dba-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:32 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 1G" returned: 0 in 0.655s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:32 devstack sudo[92947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3
Jul 31 14:52:32 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:32 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.391s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Deleted volume successfully.
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0893c25d-da36-4638-ad5c-a78cd1c33eff tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-b3ece6c3-bfdb-44c7-b126-f4b90e27dce1-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:32 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3" returned: 0 in 0.315s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:32 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 is being set with open permissions: ugo+rw
Jul 31 14:52:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:32 devstack sudo[92953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3
Jul 31 14:52:32 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:33 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8265756c-bb32-48ea-b550-d7c5274c871e tempest-SnapshotsActionsTest-1312333747 None] Create snapshot completed successfully
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "cinder-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "cinder-quobyte-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-quobyte-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0509be-be50-4a74-a14c-e65eef73bf7d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:33 devstack sudo[92956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76
Jul 31 14:52:33 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-0395104e-e77a-49bc-b30b-834af02566b3-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-0395104e-e77a-49bc-b30b-834af02566b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-0395104e-e77a-49bc-b30b-834af02566b3" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-0395104e-e77a-49bc-b30b-834af02566b3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Deleting offline snapshot 0395104e-e77a-49bc-b30b-834af02566b3 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] snapshot_file for this snap is: volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec621f5-a090-42f3-af3c-1576068e7662]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:33 devstack sudo[92958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3
Jul 31 14:52:33 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:34 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76" returned: 0 in 0.603s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:34 devstack sudo[92963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76
Jul 31 14:52:34 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:34 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3" returned: 0 in 0.409s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[03828421-5e8d-42ee-b6b5-674670f9b79a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:34 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76" returned: 0 in 0.298s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-quobyte-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76" released by "delete_volume" :: held 0.960s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Created reservations ['8e584a4a-af8b-42d0-ae82-afe43d195652', '4c7bbab5-c144-4c49-a026-5f1372f70166', '34bf3672-63c4-4c57-986a-3acb6b115357', 'ce187ae5-f3d0-4e3b-bee6-1c0c85a34bff'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:34 devstack sudo[92969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:34 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:34 devstack sudo[92972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:34 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:34 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.536s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:34 devstack sudo[92978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3
Jul 31 14:52:34 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:34 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.347s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:34 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Deleted volume successfully.
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-017bd6e2-43dd-4c3f-94df-fadc334ca550 tempest-VolumesListAdminTestJSON-1971360389 None] Lock "cinder-b9d6db23-331e-4bf4-a3ad-1504c0ca4c76-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:35 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3" returned: 0 in 0.517s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:35 devstack sudo[93013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3
Jul 31 14:52:35 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:35 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.0395104e-e77a-49bc-b30b-834af02566b3" returned: 0 in 0.320s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-0395104e-e77a-49bc-b30b-834af02566b3" released by "_delete_snapshot" :: held 1.913s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" released by "delete_snapshot" :: held 1.948s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Created reservations ['02b2a5e9-6bc2-4948-8a69-34d13f37a5eb', '103689fe-23ff-435d-b810-0779432f3f20', '16f14b2d-b8e0-4306-8064-ffec70af8269', 'dba9f2cd-67fc-4c8b-be2a-94b9881b4f23'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Delete snapshot completed successfully.
Jul 31 14:52:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-36992c46-0f03-4db2-9b94-d475d73dbe31 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-0395104e-e77a-49bc-b30b-834af02566b3-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Creating offline snapshot a3f440b9-470a-4a39-adf3-0e994e92ddb7 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fe2075-3e79-4d86-8b41-e5b10a4327e3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:36 devstack sudo[93016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:36 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:36 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.457s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:36 devstack sudo[93021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 1G
Jul 31 14:52:36 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:37 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 1G" returned: 0 in 0.590s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:37 devstack sudo[93028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7
Jul 31 14:52:37 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:37 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:37 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 is being set with open permissions: ugo+rw
Jul 31 14:52:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:37 devstack sudo[93033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7
Jul 31 14:52:37 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:38 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7" returned: 0 in 0.297s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-27b87c8b-c94a-450f-a98b-58a1a1d9d50e tempest-SnapshotsActionsTest-1312333747 None] Create snapshot completed successfully
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-a3f440b9-470a-4a39-adf3-0e994e92ddb7-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-a3f440b9-470a-4a39-adf3-0e994e92ddb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-a3f440b9-470a-4a39-adf3-0e994e92ddb7" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-a3f440b9-470a-4a39-adf3-0e994e92ddb7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Deleting offline snapshot a3f440b9-470a-4a39-adf3-0e994e92ddb7 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] snapshot_file for this snap is: volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f4acf0-93d9-4066-ac89-0b30971ac00c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:38 devstack sudo[93036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7
Jul 31 14:52:38 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:39 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7" returned: 0 in 0.414s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b2e0b-e885-41bb-9f3c-16334964b5a8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:39 devstack sudo[93042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:39 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:39 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.402s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:39 devstack sudo[93048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7
Jul 31 14:52:39 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:40 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7" returned: 0 in 0.457s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:40 devstack sudo[93057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7
Jul 31 14:52:40 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:40 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.a3f440b9-470a-4a39-adf3-0e994e92ddb7" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-a3f440b9-470a-4a39-adf3-0e994e92ddb7" released by "_delete_snapshot" :: held 1.662s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" released by "delete_snapshot" :: held 1.698s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:40 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Created reservations ['8a078046-0f96-4128-adcc-47ddd3bf8d21', 'c83f1d8c-04a7-450f-92af-2935f8b3d6ba', '38844317-dfd9-4d9a-b08d-101b5f64eff2', '2edb5ba1-6eae-4622-b65e-efabef283a89'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Delete snapshot completed successfully.
Jul 31 14:52:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80c822df-77ef-4ace-a219-62173e0d5247 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-a3f440b9-470a-4a39-adf3-0e994e92ddb7-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Creating offline snapshot 2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdcb02f-7240-4825-8ade-93a9bd23f9b0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:41 devstack sudo[93060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:41 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:41 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.415s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:41 devstack sudo[93067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 1G
Jul 31 14:52:41 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:42 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 1G" returned: 0 in 0.686s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:42 devstack sudo[93074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1
Jul 31 14:52:42 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:42 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" returned: 0 in 0.382s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:42 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 is being set with open permissions: ugo+rw
Jul 31 14:52:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:42 devstack sudo[93080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1
Jul 31 14:52:42 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:43 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" returned: 0 in 0.328s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4dc38d88-3623-4a8a-9955-8b3abf4da9bc tempest-SnapshotsActionsTest-1312333747 None] Create snapshot completed successfully
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-2f682fb4-9e10-4100-ac53-eb0f8afcd5a1-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-2f682fb4-9e10-4100-ac53-eb0f8afcd5a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Deleting offline snapshot 2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] snapshot_file for this snap is: volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[613c7a89-1a98-4a7b-a869-ea2f07f9d4f2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:43 devstack sudo[93083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1
Jul 31 14:52:43 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:44 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" returned: 0 in 0.577s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0800a6-2242-44eb-ba80-745522774e40]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:44 devstack sudo[93089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:44 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:44 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.639s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:44 devstack sudo[93096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1
Jul 31 14:52:44 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:45 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" returned: 0 in 0.408s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:45 devstack sudo[93101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1
Jul 31 14:52:45 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:45 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" returned: 0 in 0.313s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2f682fb4-9e10-4100-ac53-eb0f8afcd5a1" released by "_delete_snapshot" :: held 2.058s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" released by "delete_snapshot" :: held 2.091s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:45 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Created reservations ['c365b676-6437-45eb-ab05-68a35f6dac7e', '23ba530c-cf77-40a1-8209-ebad04275c63', 'c47b3136-9197-4c3f-b278-0c3b6b1461b1', 'abb9f6b7-a6c2-4b58-9c79-cdec8d4538c2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Delete snapshot completed successfully.
Jul 31 14:52:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d975a53a-0780-4525-b896-f52e010d5ef9 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-2f682fb4-9e10-4100-ac53-eb0f8afcd5a1-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-1fd2c180-e13f-479e-84d2-8c7c3b9a7851 req-42354c8d-28b2-4889-a6c7-8c2547cebc7d tempest-ServerActionsTestOtherA-493789991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-1fd2c180-e13f-479e-84d2-8c7c3b9a7851 req-42354c8d-28b2-4889-a6c7-8c2547cebc7d tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-1fd2c180-e13f-479e-84d2-8c7c3b9a7851 req-42354c8d-28b2-4889-a6c7-8c2547cebc7d tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-1fd2c180-e13f-479e-84d2-8c7c3b9a7851 req-42354c8d-28b2-4889-a6c7-8c2547cebc7d tempest-ServerActionsTestOtherA-493789991 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-df786180-99cf-4128-b091-c539173c3d03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ca58b79-1ac2-4453-b50d-ae690a005a4a', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:52:46 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-1fd2c180-e13f-479e-84d2-8c7c3b9a7851 req-42354c8d-28b2-4889-a6c7-8c2547cebc7d tempest-ServerActionsTestOtherA-493789991 None] attachment_update completed successfully.
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Creating offline snapshot 51592a4e-a436-43c5-9c40-b13aa82f8204 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8d8c5f-b65d-4e97-b8dc-b1a0d4675be0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:47 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:47 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Flow 'volume_create_manager' (206f9eab-09cd-4af2-8dd8-8d399ce1cbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb4c4e5-4626-4d54-8a34-7355550482e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb4c4e5-4626-4d54-8a34-7355550482e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1360147416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bd8a23-08e8-4104-b83f-94c8e65f761b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7df1315d9e424d888940b1b971da5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:48Z,use_quota=True,user_id='21c14ef4481a4cc6bf197fa08ccfcacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b03cbc5-f0c1-4192-b66c-b64fae5c4d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b03cbc5-f0c1-4192-b66c-b64fae5c4d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250ddab2-3908-467c-b859-621c17088e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250ddab2-3908-467c-b859-621c17088e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bd8a23-08e8-4104-b83f-94c8e65f761b', 'volume_name': 'volume-94bd8a23-08e8-4104-b83f-94c8e65f761b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446a1d39-d2c3-485c-961d-a25839d10845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446a1d39-d2c3-485c-961d-a25839d10845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77f37b5-565f-41e6-8379-ec1670ee5dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Volume 94bd8a23-08e8-4104-b83f-94c8e65f761b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bd8a23-08e8-4104-b83f-94c8e65f761b', 'volume_size': 1}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:48 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.593s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:48 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 1G
Jul 31 14:52:48 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:48 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 1G" returned: 0 in 0.564s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:48 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204
Jul 31 14:52:48 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:49 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204" returned: 0 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:49 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 is being set with open permissions: ugo+rw
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:49 devstack sudo[93526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204
Jul 31 14:52:49 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:49 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1360147416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bd8a23-08e8-4104-b83f-94c8e65f761b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7df1315d9e424d888940b1b971da5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:52:48Z,use_quota=True,user_id='21c14ef4481a4cc6bf197fa08ccfcacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Creating volume 94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:52:49 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:49 devstack sudo[93530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b 1073741824
Jul 31 14:52:49 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-18805a68-815a-4f5d-b5f9-c8c84a35f4f8 tempest-SnapshotsActionsTest-1312333747 None] Create snapshot completed successfully
Jul 31 14:52:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-51592a4e-a436-43c5-9c40-b13aa82f8204-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-51592a4e-a436-43c5-9c40-b13aa82f8204-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Acquiring lock "cinder-quobyte-51592a4e-a436-43c5-9c40-b13aa82f8204" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-51592a4e-a436-43c5-9c40-b13aa82f8204" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Deleting offline snapshot 51592a4e-a436-43c5-9c40-b13aa82f8204 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] snapshot_file for this snap is: volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[73086562-79c3-49f9-97bf-61dc7494d42f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:50 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b 1073741824" returned: 0 in 0.691s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:50 devstack sudo[93537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204
Jul 31 14:52:50 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:50 devstack sudo[93539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b
Jul 31 14:52:50 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:50 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b" returned: 0 in 0.326s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:50 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204" returned: 0 in 0.495s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77f37b5-565f-41e6-8379-ec1670ee5dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bd8a23-08e8-4104-b83f-94c8e65f761b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e198b3cc-ce47-4e72-9a51-c7a05d35bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c14d52e-b396-4635-acd5-1acc0fa670e4]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:50 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Volume volume-94bd8a23-08e8-4104-b83f-94c8e65f761b (94bd8a23-08e8-4104-b83f-94c8e65f761b): created successfully
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e198b3cc-ce47-4e72-9a51-c7a05d35bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:52:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Flow 'volume_create_manager' (206f9eab-09cd-4af2-8dd8-8d399ce1cbc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:52:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6dbafb8a-e736-4f77-89a6-fb30d498371b tempest-VolumesDeleteCascade-1014017860 None] Created volume successfully.
Jul 31 14:52:50 devstack sudo[93555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:50 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:51 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.548s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:51 devstack sudo[93567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204
Jul 31 14:52:51 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Creating offline snapshot 6a12c6cc-5af5-4f62-aa6d-3a069969060c of volume 94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b8e6c-79f5-43c3-b48e-6ed50414b389]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-7688860c-b97d-4646-9463-7d7bd34b3907 req-62a3ae96-c5da-4145-b80a-31a4828e911f tempest-ServerActionsTestOtherA-493789991 None] Terminate volume connection completed successfully.
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7688860c-b97d-4646-9463-7d7bd34b3907 req-62a3ae96-c5da-4145-b80a-31a4828e911f tempest-ServerActionsTestOtherA-493789991 None] Deleting attachment 3ca58b79-1ac2-4453-b50d-ae690a005a4a. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:52:51 devstack sudo[93594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b
Jul 31 14:52:51 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:51 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204" returned: 0 in 0.697s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:51 devstack sudo[93612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204
Jul 31 14:52:51 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:52 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b" returned: 0 in 0.707s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:52 devstack sudo[93622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c 1G
Jul 31 14:52:52 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:52 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.51592a4e-a436-43c5-9c40-b13aa82f8204" returned: 0 in 0.451s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-51592a4e-a436-43c5-9c40-b13aa82f8204" released by "_delete_snapshot" :: held 2.342s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" released by "delete_snapshot" :: held 2.375s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Created reservations ['1a40cdf0-e396-4ce0-aad6-c5d0c9b2d9e3', '78227ae4-28a7-41ff-9e8f-8d4a17934736', 'df94ece2-7ddb-49bb-a061-f523bafc2910', '8ed9b220-add3-42b1-a673-2e27f7417525'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:52 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Delete snapshot completed successfully.
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7688860c-b97d-4646-9463-7d7bd34b3907 req-fa5ff240-4cc6-4cb2-947f-788fbb993937 tempest-ServerActionsTestOtherA-493789991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75ea9ef6-471b-4cd5-bf84-6797d82ec380 tempest-SnapshotsActionsTest-1844916221 None] Lock "cinder-51592a4e-a436-43c5-9c40-b13aa82f8204-delete_snapshot" released by "delete_snapshot" :: held 2.665s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:52 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c 1G" returned: 0 in 0.747s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bd8a23-08e8-4104-b83f-94c8e65f761b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:52 devstack sudo[93641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bd8a23-08e8-4104-b83f-94c8e65f761b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c
Jul 31 14:52:52 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:53 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bd8a23-08e8-4104-b83f-94c8e65f761b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c" returned: 0 in 0.326s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:53 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c is being set with open permissions: ugo+rw
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:53 devstack sudo[93646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c
Jul 31 14:52:53 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:53 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c" returned: 0 in 0.309s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:53 devstack sudo[93649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.info
Jul 31 14:52:53 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "cinder-dd4f74f1-d69b-415d-97ef-fa0c63425c85-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-dd4f74f1-d69b-415d-97ef-fa0c63425c85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "cinder-quobyte-dd4f74f1-d69b-415d-97ef-fa0c63425c85" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-quobyte-dd4f74f1-d69b-415d-97ef-fa0c63425c85" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Deleting offline snapshot dd4f74f1-d69b-415d-97ef-fa0c63425c85 of volume 2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] snapshot_file for this snap is: volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fee97b-d033-470c-a1a7-a61a705ef3ed]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:53 devstack sudo[93651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:53 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:53 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.info" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:53 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.info is being set with open permissions: ugo+rw
Jul 31 14:52:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:53 devstack sudo[93654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.info
Jul 31 14:52:53 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:54 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.465s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52365799-2a0c-4411-89f6-f9fa368d2cba]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:54 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.info" returned: 0 in 0.358s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.976s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7688860c-b97d-4646-9463-7d7bd34b3907 req-fa5ff240-4cc6-4cb2-947f-788fbb993937 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.653s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-7688860c-b97d-4646-9463-7d7bd34b3907 req-fa5ff240-4cc6-4cb2-947f-788fbb993937 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:54 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9de29335-8dc1-47e9-856f-324ce56703db tempest-VolumesDeleteCascade-1014017860 None] Create snapshot completed successfully
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7688860c-b97d-4646-9463-7d7bd34b3907 req-fa5ff240-4cc6-4cb2-947f-788fbb993937 tempest-ServerActionsTestOtherA-493789991 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-df786180-99cf-4128-b091-c539173c3d03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f308fbb-8421-4f97-9e0f-69691dae9889', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:52:54 devstack sudo[93660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9
Jul 31 14:52:54 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:54 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-7688860c-b97d-4646-9463-7d7bd34b3907 req-fa5ff240-4cc6-4cb2-947f-788fbb993937 tempest-ServerActionsTestOtherA-493789991 None] attachment_update completed successfully.
Jul 31 14:52:54 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9" returned: 0 in 0.481s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:54 devstack sudo[93666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:54 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Creating offline snapshot 5b7249ee-4219-4878-9e8b-dde2dd7193d2 of volume 94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[673948df-436c-44f3-b15c-906235faad7c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:55 devstack sudo[93669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c
Jul 31 14:52:55 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:55 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.468s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:55 devstack sudo[93684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85
Jul 31 14:52:55 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:55 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c" returned: 0 in 0.493s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bd8a23-08e8-4104-b83f-94c8e65f761b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:55 devstack sudo[93692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 1G
Jul 31 14:52:55 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:55 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9.dd4f74f1-d69b-415d-97ef-fa0c63425c85" returned: 0 in 0.305s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-quobyte-dd4f74f1-d69b-415d-97ef-fa0c63425c85" released by "_delete_snapshot" :: held 1.865s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" released by "delete_snapshot" :: held 1.888s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Created reservations ['40d6a42b-9f5c-454f-a575-9d146043eaf8', '96d6e4a4-cfdd-4499-8a1c-9803939308ff', '5755c776-105a-442d-99e9-bedf6d4155bb', '557b86fa-3ded-41b7-900a-78cb24c74e41'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:55 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Delete snapshot completed successfully.
Jul 31 14:52:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00d0675e-b9eb-4da3-9f9a-0bf2f3603dde tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-dd4f74f1-d69b-415d-97ef-fa0c63425c85-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "cinder-2363d576-fcbd-4c30-9fd2-35f4305fdae9-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-2363d576-fcbd-4c30-9fd2-35f4305fdae9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" acquired by "delete_volume" :: waited 0.060s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:56 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 1G" returned: 0 in 0.830s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f3bae4-3ea5-492c-98fe-944de79cd1e1]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:56 devstack sudo[93781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2
Jul 31 14:52:56 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:56 devstack sudo[93783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9
Jul 31 14:52:56 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:56 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2" returned: 0 in 0.391s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:56 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 is being set with open permissions: ugo+rw
Jul 31 14:52:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:56 devstack sudo[94113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2
Jul 31 14:52:56 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:57 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9" returned: 0 in 0.731s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:57 devstack sudo[94125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9
Jul 31 14:52:57 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:57 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2" returned: 0 in 0.542s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-741c262f-a2b4-4e78-8340-7885739ba9ea tempest-VolumesDeleteCascade-1014017860 None] Create snapshot completed successfully
Jul 31 14:52:57 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2363d576-fcbd-4c30-9fd2-35f4305fdae9" returned: 0 in 0.396s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-quobyte-2363d576-fcbd-4c30-9fd2-35f4305fdae9" released by "delete_volume" :: held 1.287s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Created reservations ['4d2d8546-6fbb-44d9-87bc-b999a8f3b14d', '9d5de465-a4de-49fb-ad23-7082f103c802', '2e86551e-5cb2-404d-8c4d-770649e4d11d', '09458581-40ee-4803-aac1-87c2d12956a5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:57 devstack sudo[94143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:57 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:57 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:52:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Deleted volume successfully.
Jul 31 14:52:57 devstack sudo[94152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:52:57 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2ff2e95f-c105-4809-8a66-e25a9f5a7cd8 tempest-SnapshotsActionsTest-1312333747 None] Lock "cinder-2363d576-fcbd-4c30-9fd2-35f4305fdae9-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-94bd8a23-08e8-4104-b83f-94c8e65f761b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:58 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.370s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 8 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-94bd8a23-08e8-4104-b83f-94c8e65f761b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Performing cascade delete. {{(pid=88594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-5b7249ee-4219-4878-9e8b-dde2dd7193d2-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-5b7249ee-4219-4878-9e8b-dde2dd7193d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-5b7249ee-4219-4878-9e8b-dde2dd7193d2" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-5b7249ee-4219-4878-9e8b-dde2dd7193d2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Deleting offline snapshot 5b7249ee-4219-4878-9e8b-dde2dd7193d2 of volume 94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] snapshot_file for this snap is: volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46301de-b2a0-4299-9eba-1c05d3a1bfcc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:58 devstack sudo[94169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2
Jul 31 14:52:58 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:52:59 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root
Jul 31 14:52:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2" returned: 0 in 0.558s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:52:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bd8a23-08e8-4104-b83f-94c8e65f761b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:52:59 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c9c80e-a52a-4694-a68c-d8e25f17792b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:52:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:52:59 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c
Jul 31 14:52:59 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:00 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c" returned: 0 in 0.991s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bd8a23-08e8-4104-b83f-94c8e65f761b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:53:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:00 devstack sudo[94197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2
Jul 31 14:53:00 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:01 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2" returned: 0 in 0.814s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:01 devstack sudo[94215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2
Jul 31 14:53:01 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:01 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.5b7249ee-4219-4878-9e8b-dde2dd7193d2" returned: 0 in 0.355s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-5b7249ee-4219-4878-9e8b-dde2dd7193d2" released by "_delete_snapshot" :: held 2.920s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" released by "delete_snapshot" :: held 2.960s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Created reservations ['dcfb989e-371e-48b2-b171-fec93678fa9c', 'd82baf82-4998-4429-83f8-bb9818e5dab6', 'e4df045f-0c36-4503-9eb1-25bec503af0e', '95c6b4cd-5ac3-432b-ad7a-3338a8d7cda8'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:01 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Delete snapshot completed successfully.
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-5b7249ee-4219-4878-9e8b-dde2dd7193d2-delete_snapshot" released by "delete_snapshot" :: held 3.217s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-6a12c6cc-5af5-4f62-aa6d-3a069969060c-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-6a12c6cc-5af5-4f62-aa6d-3a069969060c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-6a12c6cc-5af5-4f62-aa6d-3a069969060c" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-6a12c6cc-5af5-4f62-aa6d-3a069969060c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Deleting offline snapshot 6a12c6cc-5af5-4f62-aa6d-3a069969060c of volume 94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] snapshot_file for this snap is: volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3229a6b0-10ac-4041-895f-85258b23b55d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:02 devstack sudo[94219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c
Jul 31 14:53:02 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:02 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c" returned: 0 in 0.644s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bd8a23-08e8-4104-b83f-94c8e65f761b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:53:02 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c0699c-7b78-4d9a-aecb-11a01c7ff0bc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:02 devstack sudo[94224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b
Jul 31 14:53:02 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:03 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b" returned: 0 in 0.542s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:03 devstack sudo[94230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c
Jul 31 14:53:03 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:03 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c" returned: 0 in 0.402s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:03 devstack sudo[94236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c
Jul 31 14:53:03 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:04 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b.6a12c6cc-5af5-4f62-aa6d-3a069969060c" returned: 0 in 0.509s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-6a12c6cc-5af5-4f62-aa6d-3a069969060c" released by "_delete_snapshot" :: held 2.282s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" released by "delete_snapshot" :: held 2.328s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Created reservations ['2ff3d843-d6a7-4aad-b526-6816d7c2d40b', '6a8029d5-98e2-4ef6-b53c-3c5fcfc10e62', 'a5832cf6-f104-4388-8abf-39de6c45ac41', '47c21191-0e99-4bbb-ae8d-414c3fa1343c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Delete snapshot completed successfully.
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-6a12c6cc-5af5-4f62-aa6d-3a069969060c-delete_snapshot" released by "delete_snapshot" :: held 2.651s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Snapshots deleted, issuing volume delete {{(pid=88594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5695db-2669-4635-a502-36a6cd356b2d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:04 devstack sudo[94251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b
Jul 31 14:53:04 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:05 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b" returned: 0 in 1.330s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:05 devstack sudo[94299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b
Jul 31 14:53:05 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:06 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-94bd8a23-08e8-4104-b83f-94c8e65f761b" returned: 0 in 0.403s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-94bd8a23-08e8-4104-b83f-94c8e65f761b" released by "delete_volume" :: held 1.935s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Created reservations ['34be7ef0-0d4b-455a-8ccc-016b7d81dfba', '66ae7010-4243-48d1-8cc7-29d7e0ce2bc8', 'c35f0eca-9f6f-4910-a8c1-0786b6a29ecc', '818cc561-5ae8-4457-b53e-44fb58555099'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:06 devstack sudo[94321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:06 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:06 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.309s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Deleted volume successfully.
Jul 31 14:53:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e92ae34e-75e6-4099-8a5c-ae5218eaf5e6 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-94bd8a23-08e8-4104-b83f-94c8e65f761b-delete_volume" released by "delete_volume" :: held 8.601s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Flow 'volume_create_manager' (829c403c-3429-462f-b324-c2f069c6db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ee762-0728-44fd-9765-259aaace3add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ee762-0728-44fd-9765-259aaace3add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1517012432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bb58a4-cdff-4510-aa9a-45329abed331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7df1315d9e424d888940b1b971da5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:09Z,use_quota=True,user_id='21c14ef4481a4cc6bf197fa08ccfcacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38294e0d-fee9-4334-8ac5-7cc44d83152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38294e0d-fee9-4334-8ac5-7cc44d83152b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59c6e8a-b9f6-4ddc-8a24-b4ba85bc7d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59c6e8a-b9f6-4ddc-8a24-b4ba85bc7d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1bb58a4-cdff-4510-aa9a-45329abed331', 'volume_name': 'volume-c1bb58a4-cdff-4510-aa9a-45329abed331', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cb07c2-2428-41f0-b577-1467fc03cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cb07c2-2428-41f0-b577-1467fc03cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81cb848-9a9a-4875-8af0-f98efb188cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:09 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Volume c1bb58a4-cdff-4510-aa9a-45329abed331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1bb58a4-cdff-4510-aa9a-45329abed331', 'volume_size': 1}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1517012432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bb58a4-cdff-4510-aa9a-45329abed331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7df1315d9e424d888940b1b971da5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:09Z,use_quota=True,user_id='21c14ef4481a4cc6bf197fa08ccfcacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Creating volume c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:09 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:09 devstack sudo[94386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 1073741824
Jul 31 14:53:09 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:09 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 1073741824" returned: 0 in 0.860s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:10 devstack sudo[94391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331
Jul 31 14:53:10 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:10 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331" returned: 0 in 0.447s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:53:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81cb848-9a9a-4875-8af0-f98efb188cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1bb58a4-cdff-4510-aa9a-45329abed331', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5102555b-f516-4b3f-891c-a34ba27f3263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Volume volume-c1bb58a4-cdff-4510-aa9a-45329abed331 (c1bb58a4-cdff-4510-aa9a-45329abed331): created successfully
Jul 31 14:53:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5102555b-f516-4b3f-891c-a34ba27f3263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Flow 'volume_create_manager' (829c403c-3429-462f-b324-c2f069c6db82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-27d140c2-f6d1-483c-aeb7-fbefdb5133f5 tempest-VolumesDeleteCascade-1014017860 None] Created volume successfully.
Jul 31 14:53:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Creating offline snapshot 945352b3-41b8-486f-a2b9-8a6ae1de3c94 of volume c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:53:11 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e47b6-2800-48e3-97ba-cd05427af4eb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:11 devstack sudo[94397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331
Jul 31 14:53:11 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:12 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331" returned: 0 in 0.511s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:12 devstack sudo[94404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 1G
Jul 31 14:53:12 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:12 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 1G" returned: 0 in 0.602s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1bb58a4-cdff-4510-aa9a-45329abed331 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:12 devstack sudo[94409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1bb58a4-cdff-4510-aa9a-45329abed331 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94
Jul 31 14:53:12 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:13 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1bb58a4-cdff-4510-aa9a-45329abed331 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94" returned: 0 in 0.412s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:13 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 is being set with open permissions: ugo+rw
Jul 31 14:53:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:13 devstack sudo[94456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94
Jul 31 14:53:13 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:13 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94" returned: 0 in 0.352s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:13 devstack sudo[94459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.info
Jul 31 14:53:13 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:13 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.info" returned: 0 in 0.314s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:13 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.info is being set with open permissions: ugo+rw
Jul 31 14:53:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:13 devstack sudo[94462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.info
Jul 31 14:53:13 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:14 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.info" returned: 0 in 0.364s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:14 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=115,cinder:UPDATE=130,cinder:INSERT=37,cinder:DELETE=12 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:53:14 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=133,cinder:SELECT=136,cinder:INSERT=30,cinder:DELETE=9 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:53:14 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-286e2cc1-10c1-40d0-adc1-a12654c1eb94 tempest-VolumesDeleteCascade-1014017860 None] Create snapshot completed successfully
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Flow 'volume_create_manager' (ed6f11cb-28a0-43bb-a180-7f6b2149f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d7ec3-35aa-4451-96b1-563a47011c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d7ec3-35aa-4451-96b1-563a47011c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1247807888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20583ed3-85fe-4551-91bd-8048347e0747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7df1315d9e424d888940b1b971da5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=945352b3-41b8-486f-a2b9-8a6ae1de3c94,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:15Z,use_quota=True,user_id='21c14ef4481a4cc6bf197fa08ccfcacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed922c4-1aa4-45fe-860f-613da5bef337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed922c4-1aa4-45fe-860f-613da5bef337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98e2549-196f-44cf-84f3-828982cbb0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98e2549-196f-44cf-84f3-828982cbb0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20583ed3-85fe-4551-91bd-8048347e0747', 'volume_name': 'volume-20583ed3-85fe-4551-91bd-8048347e0747', 'volume_size': 1, 'snapshot_id': '945352b3-41b8-486f-a2b9-8a6ae1de3c94'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceda0f6-6668-43ee-8edf-296e9b774a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceda0f6-6668-43ee-8edf-296e9b774a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50885cad-6810-495b-9e03-c96e2ecbe392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:15 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Volume 20583ed3-85fe-4551-91bd-8048347e0747: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20583ed3-85fe-4551-91bd-8048347e0747', 'volume_size': 1, 'snapshot_id': '945352b3-41b8-486f-a2b9-8a6ae1de3c94'}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-945352b3-41b8-486f-a2b9-8a6ae1de3c94-20583ed3-85fe-4551-91bd-8048347e0747" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-945352b3-41b8-486f-a2b9-8a6ae1de3c94-20583ed3-85fe-4551-91bd-8048347e0747" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Creating volume 20583ed3-85fe-4551-91bd-8048347e0747 from snapshot 945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-20583ed3-85fe-4551-91bd-8048347e0747" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-20583ed3-85fe-4551-91bd-8048347e0747" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] snapshot: 945352b3-41b8-486f-a2b9-8a6ae1de3c94, volume: 20583ed3-85fe-4551-91bd-8048347e0747,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9c23de-2273-4280-a74b-779a1422777b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:15 devstack sudo[94468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94
Jul 31 14:53:15 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:15 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94" returned: 0 in 0.395s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1bb58a4-cdff-4510-aa9a-45329abed331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c325567-7c5b-4be1-ab67-714572fc7c67]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:16 devstack sudo[94497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331
Jul 31 14:53:16 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:16 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331" returned: 0 in 0.456s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 14:53:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 14:53:16 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747 not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 14:53:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:16 devstack sudo[94505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747
Jul 31 14:53:16 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:23 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747" returned: 0 in 6.903s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:53:23 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Converted 1024.00 MB image at 148.31 MB/s
Jul 31 14:53:23 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747 is being set with open permissions: ugo+rw
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:23 devstack sudo[94566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747
Jul 31 14:53:23 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:23 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-20583ed3-85fe-4551-91bd-8048347e0747" released by "_copy_volume_from_snapshot" :: held 8.126s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-945352b3-41b8-486f-a2b9-8a6ae1de3c94-20583ed3-85fe-4551-91bd-8048347e0747" released by "_create_volume_from_snapshot" :: held 8.201s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.229s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50885cad-6810-495b-9e03-c96e2ecbe392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20583ed3-85fe-4551-91bd-8048347e0747', 'volume_size': 1, 'snapshot_id': '945352b3-41b8-486f-a2b9-8a6ae1de3c94'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9501558-ec3e-4387-812a-f2eface22851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Volume volume-20583ed3-85fe-4551-91bd-8048347e0747 (20583ed3-85fe-4551-91bd-8048347e0747): created successfully
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9501558-ec3e-4387-812a-f2eface22851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Flow 'volume_create_manager' (ed6f11cb-28a0-43bb-a180-7f6b2149f574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:23 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-eea8bec6-da43-4148-bcda-fc3100acbfc4 tempest-VolumesDeleteCascade-1014017860 None] Created volume successfully.
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-c1bb58a4-cdff-4510-aa9a-45329abed331-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-c1bb58a4-cdff-4510-aa9a-45329abed331-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Performing cascade delete. {{(pid=88594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-945352b3-41b8-486f-a2b9-8a6ae1de3c94-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-945352b3-41b8-486f-a2b9-8a6ae1de3c94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-c1bb58a4-cdff-4510-aa9a-45329abed331" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-c1bb58a4-cdff-4510-aa9a-45329abed331" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-945352b3-41b8-486f-a2b9-8a6ae1de3c94" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-945352b3-41b8-486f-a2b9-8a6ae1de3c94" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Deleting offline snapshot 945352b3-41b8-486f-a2b9-8a6ae1de3c94 of volume c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] snapshot_file for this snap is: volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6f8536-ef68-4871-962f-3d8f3fe7e252]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:24 devstack sudo[94578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94
Jul 31 14:53:24 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:25 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-3d351ddc-1955-4b21-b36a-67131e6f5adf req-6a496d7d-ecf4-4a6a-a92c-c2348fe70efd tempest-ServerActionsTestOtherA-493789991 None] Terminate volume connection completed successfully.
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-3d351ddc-1955-4b21-b36a-67131e6f5adf req-6a496d7d-ecf4-4a6a-a92c-c2348fe70efd tempest-ServerActionsTestOtherA-493789991 None] Deleting attachment 6f308fbb-8421-4f97-9e0f-69691dae9889. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94" returned: 0 in 0.469s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1bb58a4-cdff-4510-aa9a-45329abed331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e25b64-1001-4803-b4ac-b80cd21b70da]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Flow 'volume_create_manager' (fc7a69db-656c-430a-ab92-33702c024d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a550d835-eb5e-416b-8a74-7e4bccb8d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a550d835-eb5e-416b-8a74-7e4bccb8d28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1612744009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59cb313-b0d7-4281-8d62-66badf2dba05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f99f87d10c446a598a9ee231c213b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:25Z,use_quota=True,user_id='c9732eab689742bfbbff4fb4276e1c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105d7f75-f699-417f-83e7-dc8eee02e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105d7f75-f699-417f-83e7-dc8eee02e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:25 devstack sudo[94590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331
Jul 31 14:53:25 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ac79e8-c804-4a2a-b7d0-d02ef2c53b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ac79e8-c804-4a2a-b7d0-d02ef2c53b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59cb313-b0d7-4281-8d62-66badf2dba05', 'volume_name': 'volume-e59cb313-b0d7-4281-8d62-66badf2dba05', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60211a69-a70e-4f50-a292-e6ab25c450ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60211a69-a70e-4f50-a292-e6ab25c450ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b6e59d-0565-4336-b941-ac5ab242cf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Volume e59cb313-b0d7-4281-8d62-66badf2dba05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59cb313-b0d7-4281-8d62-66badf2dba05', 'volume_size': 1}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1612744009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59cb313-b0d7-4281-8d62-66badf2dba05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f99f87d10c446a598a9ee231c213b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:25Z,use_quota=True,user_id='c9732eab689742bfbbff4fb4276e1c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Creating volume e59cb313-b0d7-4281-8d62-66badf2dba05 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:25 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:25 devstack sudo[94592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05 1073741824
Jul 31 14:53:25 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:25 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331" returned: 0 in 0.565s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:25 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05 1073741824" returned: 0 in 0.420s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:25 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94
Jul 31 14:53:25 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:26 devstack sudo[94603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05
Jul 31 14:53:26 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:26 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05" returned: 0 in 0.302s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b6e59d-0565-4336-b941-ac5ab242cf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59cb313-b0d7-4281-8d62-66badf2dba05', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c1b099-ebd9-48b8-ae40-0239c968742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:26 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Volume volume-e59cb313-b0d7-4281-8d62-66badf2dba05 (e59cb313-b0d7-4281-8d62-66badf2dba05): created successfully
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c1b099-ebd9-48b8-ae40-0239c968742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Flow 'volume_create_manager' (fc7a69db-656c-430a-ab92-33702c024d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:26 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94" returned: 0 in 0.430s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:26 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f113f9bf-2712-4dd4-b694-5c7547115828 tempest-VolumesServicesTestJSON-1388456983 None] Created volume successfully.
Jul 31 14:53:26 devstack sudo[94611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94
Jul 31 14:53:26 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:26 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Acquiring lock "cinder-e59cb313-b0d7-4281-8d62-66badf2dba05-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331.945352b3-41b8-486f-a2b9-8a6ae1de3c94" returned: 0 in 0.310s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-945352b3-41b8-486f-a2b9-8a6ae1de3c94" released by "_delete_snapshot" :: held 1.939s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Lock "cinder-e59cb313-b0d7-4281-8d62-66badf2dba05-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-c1bb58a4-cdff-4510-aa9a-45329abed331" released by "delete_snapshot" :: held 1.999s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Acquiring lock "cinder-quobyte-e59cb313-b0d7-4281-8d62-66badf2dba05" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Lock "cinder-quobyte-e59cb313-b0d7-4281-8d62-66badf2dba05" acquired by "delete_volume" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[825f4d80-c03d-4a2c-ac3b-27a9d62673bc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:26 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Created reservations ['3471c448-c023-4974-9906-c085e0095f21', 'dfdb35e1-1a52-4496-a881-0e01792a6985', 'fe093a18-1551-4042-ba9d-20539629c98b', '93bacf19-40ac-498e-9a1a-492b2818fe47'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Delete snapshot completed successfully.
Jul 31 14:53:27 devstack sudo[94636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05
Jul 31 14:53:27 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-945352b3-41b8-486f-a2b9-8a6ae1de3c94-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Snapshots deleted, issuing volume delete {{(pid=88594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-c1bb58a4-cdff-4510-aa9a-45329abed331" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-c1bb58a4-cdff-4510-aa9a-45329abed331" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638018f-18d9-4cdd-a703-ce092f1592e2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:27 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331
Jul 31 14:53:27 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:27 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05" returned: 0 in 0.479s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:27 devstack sudo[94647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05
Jul 31 14:53:27 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:27 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331" returned: 0 in 0.430s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:27 devstack sudo[94652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331
Jul 31 14:53:27 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:27 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e59cb313-b0d7-4281-8d62-66badf2dba05" returned: 0 in 0.320s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Lock "cinder-quobyte-e59cb313-b0d7-4281-8d62-66badf2dba05" released by "delete_volume" :: held 0.886s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Created reservations ['c66c8384-2560-4333-bce9-6e8baf794a06', '8f519236-6ded-4cc6-a04b-c1a2d96b448c', 'a13c2c51-59cf-42dd-a76e-31546a934721', '33000638-8975-4a89-83da-562f56f19074'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:27 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c1bb58a4-cdff-4510-aa9a-45329abed331" returned: 0 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:27 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:27 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-c1bb58a4-cdff-4510-aa9a-45329abed331" released by "delete_volume" :: held 0.882s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Created reservations ['d617eedd-30f3-477a-a05e-ebc06bbfef85', 'f69b1cd3-6ae7-4e09-a0d9-dd889396a1be', '50d2de0f-00ce-4160-af76-101df2f47388', 'e81fb046-8055-4c3e-ba8d-c05c2b6235cc'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:28 devstack sudo[94660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:28 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:28 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.266s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Deleted volume successfully.
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-122b7d4d-b0cf-40fa-b3e4-2f1cad4c1407 tempest-VolumesServicesTestJSON-1388456983 None] Lock "cinder-e59cb313-b0d7-4281-8d62-66badf2dba05-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:28 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Deleted volume successfully.
Jul 31 14:53:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d2dc6d2-4475-47b1-b591-f2f16670a570 tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-c1bb58a4-cdff-4510-aa9a-45329abed331-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-20583ed3-85fe-4551-91bd-8048347e0747-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-20583ed3-85fe-4551-91bd-8048347e0747-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "cinder-quobyte-20583ed3-85fe-4551-91bd-8048347e0747" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-20583ed3-85fe-4551-91bd-8048347e0747" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35222d-2e16-499b-aa1a-ae7c1e7176ad]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:29 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747
Jul 31 14:53:29 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:29 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747" returned: 0 in 0.422s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:29 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747
Jul 31 14:53:29 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:30 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20583ed3-85fe-4551-91bd-8048347e0747" returned: 0 in 0.329s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-quobyte-20583ed3-85fe-4551-91bd-8048347e0747" released by "delete_volume" :: held 0.818s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Created reservations ['0eee388a-44a5-42dc-a013-1f662a5b8613', '6cf5801d-c995-4784-aa07-c831d0972b09', '90ad968f-6304-4f48-845e-2e8fc8cc749d', '88cdbfe6-bad2-4695-b314-dce9309edc5c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:30 devstack sudo[94673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:30 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:30 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.461s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:30 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Deleted volume successfully.
Jul 31 14:53:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e20f3d94-5df3-46f5-ac55-531c3b7ba72c tempest-VolumesDeleteCascade-1014017860 None] Lock "cinder-20583ed3-85fe-4551-91bd-8048347e0747-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Acquiring lock "cinder-df786180-99cf-4128-b091-c539173c3d03-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Lock "cinder-df786180-99cf-4128-b091-c539173c3d03-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Acquiring lock "cinder-quobyte-df786180-99cf-4128-b091-c539173c3d03" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Lock "cinder-quobyte-df786180-99cf-4128-b091-c539173c3d03" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbcf20a-0c21-453a-9be5-d4d12d0d8866]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:31 devstack sudo[94682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03
Jul 31 14:53:31 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Flow 'volume_create_manager' (f74ddbbc-53e6-4c00-87c6-7d9a06e5cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786fbb60-ccaa-423c-adae-f22a14f3bed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786fbb60-ccaa-423c-adae-f22a14f3bed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1070489347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe415c7-b4c9-4ad0-9c24-447dd693961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f3504e9c80412a8a36f9caf978be12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:32Z,use_quota=True,user_id='44c965e7e06746b99bdd278cb9211175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:32 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3c7ddf-feeb-438e-9289-cbd30b1db970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3c7ddf-feeb-438e-9289-cbd30b1db970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d853ef3-26ca-4e9c-b074-8acb28f5cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d853ef3-26ca-4e9c-b074-8acb28f5cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe415c7-b4c9-4ad0-9c24-447dd693961e', 'volume_name': 'volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9cdde1-a147-48fd-b862-f403b4e9bc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9cdde1-a147-48fd-b862-f403b4e9bc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee7e8bc-99a7-4451-af4d-a3bda1380048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:32 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Volume ffe415c7-b4c9-4ad0-9c24-447dd693961e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e', 'volume_size': 1}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1070489347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe415c7-b4c9-4ad0-9c24-447dd693961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f3504e9c80412a8a36f9caf978be12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:32Z,use_quota=True,user_id='44c965e7e06746b99bdd278cb9211175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Creating volume ffe415c7-b4c9-4ad0-9c24-447dd693961e {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:32 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03" returned: 0 in 0.647s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:32 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e 1073741824
Jul 31 14:53:32 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:32 devstack sudo[94689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03
Jul 31 14:53:32 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:32 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-df786180-99cf-4128-b091-c539173c3d03" returned: 0 in 0.276s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Lock "cinder-quobyte-df786180-99cf-4128-b091-c539173c3d03" released by "delete_volume" :: held 1.002s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Created reservations ['9454569f-5073-4a5f-b3bb-c5c1a5f444c4', 'aca0001c-24f2-4d2b-bfc0-1a66e99e0e29', '8e6410b7-56cb-454b-9804-b21f7fe23f52', '9d41cf08-f3b7-43bc-aa3e-2255c789b017'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:32 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:32 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:32 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e 1073741824" returned: 0 in 0.607s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:32 devstack sudo[94699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e
Jul 31 14:53:32 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:32 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.386s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Deleted volume successfully.
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eabed579-65b1-47ff-a63e-4e29fb7826c7 tempest-ServerActionsTestOtherA-493789991 None] Lock "cinder-df786180-99cf-4128-b091-c539173c3d03-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:33 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e" returned: 0 in 0.365s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee7e8bc-99a7-4451-af4d-a3bda1380048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddedb46d-7328-41fb-8c00-bb4b839e4f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:33 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Volume volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e (ffe415c7-b4c9-4ad0-9c24-447dd693961e): created successfully
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddedb46d-7328-41fb-8c00-bb4b839e4f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Flow 'volume_create_manager' (f74ddbbc-53e6-4c00-87c6-7d9a06e5cab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3d1d0be9-b122-42cc-a493-2ddcc9783f71 tempest-AttachVolumeTestJSON-506879225 None] Created volume successfully.
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-be9ffff3-d90d-4c00-971b-2b9e7229e535 req-bdd3c858-326e-4427-a57e-e292b3f346e2 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-be9ffff3-d90d-4c00-971b-2b9e7229e535 req-bdd3c858-326e-4427-a57e-e292b3f346e2 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-be9ffff3-d90d-4c00-971b-2b9e7229e535 req-bdd3c858-326e-4427-a57e-e292b3f346e2 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Flow 'volume_create_manager' (b5278219-2962-4545-9b4f-827fb8b53886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5d1cad-0377-4c65-bf4b-72e034a0c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-be9ffff3-d90d-4c00-971b-2b9e7229e535 req-bdd3c858-326e-4427-a57e-e292b3f346e2 tempest-AttachVolumeTestJSON-506879225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1729076b-e87f-4e11-93bc-326145c1e42c', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5d1cad-0377-4c65-bf4b-72e034a0c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-746064477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5979025a-97fd-4ecf-92a9-526631cf4384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74531b68ea1b41d688d3ea2eefef601f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:36Z,use_quota=True,user_id='b5b23887228d4faba0179aabd9bbf3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f8d097-b313-4497-9e46-93a6224504ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f8d097-b313-4497-9e46-93a6224504ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd14c7cc-ebd8-42fc-b2b4-7a00eef70e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd14c7cc-ebd8-42fc-b2b4-7a00eef70e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5979025a-97fd-4ecf-92a9-526631cf4384', 'volume_name': 'volume-5979025a-97fd-4ecf-92a9-526631cf4384', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff6c63-05d4-4a54-b5c2-5db900056454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff6c63-05d4-4a54-b5c2-5db900056454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c2509-39dc-4489-9233-9c0b78c50e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:35 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Volume 5979025a-97fd-4ecf-92a9-526631cf4384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5979025a-97fd-4ecf-92a9-526631cf4384', 'volume_size': 1}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-746064477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5979025a-97fd-4ecf-92a9-526631cf4384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74531b68ea1b41d688d3ea2eefef601f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:36Z,use_quota=True,user_id='b5b23887228d4faba0179aabd9bbf3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Creating volume 5979025a-97fd-4ecf-92a9-526631cf4384 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:35 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:36 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384 1073741824
Jul 31 14:53:36 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-be9ffff3-d90d-4c00-971b-2b9e7229e535 req-bdd3c858-326e-4427-a57e-e292b3f346e2 tempest-AttachVolumeTestJSON-506879225 None] attachment_update completed successfully.
Jul 31 14:53:36 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384 1073741824" returned: 0 in 0.771s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:36 devstack sudo[95133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384
Jul 31 14:53:36 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:37 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384" returned: 0 in 0.397s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:53:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c2509-39dc-4489-9233-9c0b78c50e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5979025a-97fd-4ecf-92a9-526631cf4384', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f354b0-044b-4201-a09a-62e04acf007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:37 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Volume volume-5979025a-97fd-4ecf-92a9-526631cf4384 (5979025a-97fd-4ecf-92a9-526631cf4384): created successfully
Jul 31 14:53:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f354b0-044b-4201-a09a-62e04acf007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Flow 'volume_create_manager' (b5278219-2962-4545-9b4f-827fb8b53886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:37 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-02dc4a0a-d3bc-4bfd-87f2-bbcd80b9a297 tempest-VolumesListTestJSON-1394199762 None] Created volume successfully.
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Flow 'volume_create_manager' (076c8eba-336b-4759-9102-e444841c9f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184ecae1-94b0-4bf3-83f2-581b2fc76cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184ecae1-94b0-4bf3-83f2-581b2fc76cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572531875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b1e1bb-5b75-4333-95d4-77f9c3a7caf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74531b68ea1b41d688d3ea2eefef601f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:38Z,use_quota=True,user_id='b5b23887228d4faba0179aabd9bbf3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24ed918-1558-4806-b38c-7929f3be2163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24ed918-1558-4806-b38c-7929f3be2163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36e8569-dbe6-4743-bfd3-f64eaf7aab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36e8569-dbe6-4743-bfd3-f64eaf7aab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b1e1bb-5b75-4333-95d4-77f9c3a7caf5', 'volume_name': 'volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2a1d1f-7ddf-4e05-a6cb-3472d6895513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2a1d1f-7ddf-4e05-a6cb-3472d6895513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3804c380-bace-49e0-95ab-af44b858681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Volume 98b1e1bb-5b75-4333-95d4-77f9c3a7caf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5', 'volume_size': 1}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572531875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b1e1bb-5b75-4333-95d4-77f9c3a7caf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74531b68ea1b41d688d3ea2eefef601f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:38Z,use_quota=True,user_id='b5b23887228d4faba0179aabd9bbf3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Creating volume 98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:38 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:38 devstack sudo[95138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 1073741824
Jul 31 14:53:38 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:39 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 1073741824" returned: 0 in 0.624s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:39 devstack sudo[95152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5
Jul 31 14:53:39 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:39 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5" returned: 0 in 0.353s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3804c380-bace-49e0-95ab-af44b858681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f00184-107e-473c-b48a-adb764d1e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Volume volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 (98b1e1bb-5b75-4333-95d4-77f9c3a7caf5): created successfully
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f00184-107e-473c-b48a-adb764d1e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Flow 'volume_create_manager' (076c8eba-336b-4759-9102-e444841c9f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a8f66432-8aa2-42be-b253-bd793027a0f5 tempest-VolumesListTestJSON-1394199762 None] Created volume successfully.
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Flow 'volume_create_manager' (54fc9067-c672-4b94-a451-99c0097ea6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de2a066-30d1-43fd-a2d2-8f5a59402ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de2a066-30d1-43fd-a2d2-8f5a59402ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1647584466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e488d2-ee0e-4f4b-b587-ad1658ec8581,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74531b68ea1b41d688d3ea2eefef601f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:41Z,use_quota=True,user_id='b5b23887228d4faba0179aabd9bbf3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183020ea-bfb2-416b-bef0-5ced714284b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183020ea-bfb2-416b-bef0-5ced714284b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556f2586-5de0-4620-9086-55e1959b4471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556f2586-5de0-4620-9086-55e1959b4471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e488d2-ee0e-4f4b-b587-ad1658ec8581', 'volume_name': 'volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9685dc1c-7805-4b6a-bb63-bc29f007947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9685dc1c-7805-4b6a-bb63-bc29f007947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a0657b-801a-4f3b-9c3a-28692f3f1adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:41 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Volume 36e488d2-ee0e-4f4b-b587-ad1658ec8581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581', 'volume_size': 1}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1647584466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e488d2-ee0e-4f4b-b587-ad1658ec8581,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74531b68ea1b41d688d3ea2eefef601f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:41Z,use_quota=True,user_id='b5b23887228d4faba0179aabd9bbf3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Creating volume 36e488d2-ee0e-4f4b-b587-ad1658ec8581 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:41 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:41 devstack sudo[95157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581 1073741824
Jul 31 14:53:41 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:42 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581 1073741824" returned: 0 in 0.710s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:42 devstack sudo[95164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581
Jul 31 14:53:42 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:42 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581" returned: 0 in 0.377s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a0657b-801a-4f3b-9c3a-28692f3f1adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432f5467-566d-42d1-af12-5c439ea7e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Volume volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581 (36e488d2-ee0e-4f4b-b587-ad1658ec8581): created successfully
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432f5467-566d-42d1-af12-5c439ea7e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Flow 'volume_create_manager' (54fc9067-c672-4b94-a451-99c0097ea6cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:42 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7f617aca-c283-4ee9-9722-cee8d04619c2 tempest-VolumesListTestJSON-1394199762 None] Created volume successfully.
Jul 31 14:53:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "cinder-36e488d2-ee0e-4f4b-b587-ad1658ec8581-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-36e488d2-ee0e-4f4b-b587-ad1658ec8581-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "cinder-quobyte-36e488d2-ee0e-4f4b-b587-ad1658ec8581" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-quobyte-36e488d2-ee0e-4f4b-b587-ad1658ec8581" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:47 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4360cb89-0ff2-46c2-be73-85f71404fa88]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:47 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581
Jul 31 14:53:47 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:47 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581" returned: 0 in 0.640s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:47 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581
Jul 31 14:53:47 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:48 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-36e488d2-ee0e-4f4b-b587-ad1658ec8581" returned: 0 in 0.381s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-quobyte-36e488d2-ee0e-4f4b-b587-ad1658ec8581" released by "delete_volume" :: held 1.115s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Created reservations ['000e2e1c-552f-4045-bdb3-6e1a4ea4e9c0', '2c2a4024-6bce-4fd1-be7c-5d396b0472dd', 'e7a932e3-5bdb-4a78-b192-0bd6ccb850fd', '566756ae-3298-4815-ac62-5fdf46193ee7'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:48 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:48 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:48 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.359s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Deleted volume successfully.
Jul 31 14:53:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b60e31df-2b06-4863-9efa-d9cfbad416d0 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-36e488d2-ee0e-4f4b-b587-ad1658ec8581-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "cinder-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "cinder-quobyte-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-quobyte-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36dd11e-1bd5-4c12-8e87-6fcda66287f8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:49 devstack sudo[95703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5
Jul 31 14:53:49 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:50 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5" returned: 0 in 0.547s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:50 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5
Jul 31 14:53:50 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:50 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5" returned: 0 in 0.297s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-quobyte-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5" released by "delete_volume" :: held 0.910s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Created reservations ['2e369304-af73-4742-8eea-aa216298872b', '40fdd25f-73c3-4fed-aaac-001413c6d5cb', '6da767ca-a33c-49dd-90c3-bb447e78e5b4', '8f973306-97e0-45c9-88a7-85c2c56ac6d2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:50 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:50 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "cinder-5979025a-97fd-4ecf-92a9-526631cf4384-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-5979025a-97fd-4ecf-92a9-526631cf4384-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "cinder-quobyte-5979025a-97fd-4ecf-92a9-526631cf4384" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-quobyte-5979025a-97fd-4ecf-92a9-526631cf4384" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:51 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.393s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d9584-d853-4e64-b759-b2fc5689a028]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Deleted volume successfully.
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d9b25c3c-2266-4905-9b52-73e0000e7875 tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-98b1e1bb-5b75-4333-95d4-77f9c3a7caf5-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:51 devstack sudo[95714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384
Jul 31 14:53:51 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:51 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384" returned: 0 in 0.540s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:51 devstack sudo[95719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384
Jul 31 14:53:51 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:51 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5979025a-97fd-4ecf-92a9-526631cf4384" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-quobyte-5979025a-97fd-4ecf-92a9-526631cf4384" released by "delete_volume" :: held 0.924s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Created reservations ['d0ee654f-b2a2-4830-9503-806a6777141d', 'be3bae07-8974-4792-9b92-f8e27c015b7b', '03d337e3-79c3-4c8a-a814-4afa07671f9a', '2c1ff8d4-9762-47a3-8cca-89f5c2271bd6'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:52 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:52 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:52 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:52 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Deleted volume successfully.
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38776ddc-46a2-4076-bc9c-dec2a2d2fead tempest-VolumesListTestJSON-1394199762 None] Lock "cinder-5979025a-97fd-4ecf-92a9-526631cf4384-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Flow 'volume_create_manager' (4a2eed8a-95dd-437f-ae9b-89894ce50f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdee7a3-deb2-4295-a473-77f7f8a93492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdee7a3-deb2-4295-a473-77f7f8a93492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1007677703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b27152e-33c5-40ba-8e40-d199cbfb7952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf6ef114724452941550d18ddb55b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:53Z,use_quota=True,user_id='0392d61bf8de45098f1b7c9a195ce35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84099f49-1258-468c-bb7a-11fe13ec0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84099f49-1258-468c-bb7a-11fe13ec0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25657d8e-4e4b-47e7-b657-c24179913e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25657d8e-4e4b-47e7-b657-c24179913e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b27152e-33c5-40ba-8e40-d199cbfb7952', 'volume_name': 'volume-2b27152e-33c5-40ba-8e40-d199cbfb7952', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5780dd8e-1482-4a1e-ac64-ab8cfff77bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5780dd8e-1482-4a1e-ac64-ab8cfff77bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6bf561-6652-4434-8739-495b1eefd5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:52 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Volume 2b27152e-33c5-40ba-8e40-d199cbfb7952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b27152e-33c5-40ba-8e40-d199cbfb7952', 'volume_size': 1}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1007677703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b27152e-33c5-40ba-8e40-d199cbfb7952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf6ef114724452941550d18ddb55b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:53Z,use_quota=True,user_id='0392d61bf8de45098f1b7c9a195ce35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Creating volume 2b27152e-33c5-40ba-8e40-d199cbfb7952 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:52 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:52 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952 1073741824
Jul 31 14:53:52 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:53 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952 1073741824" returned: 0 in 0.512s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:53 devstack sudo[95732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952
Jul 31 14:53:53 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:53 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6bf561-6652-4434-8739-495b1eefd5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b27152e-33c5-40ba-8e40-d199cbfb7952', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f24e4b2-80f6-4fb5-a944-d74c66288350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:53 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Volume volume-2b27152e-33c5-40ba-8e40-d199cbfb7952 (2b27152e-33c5-40ba-8e40-d199cbfb7952): created successfully
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f24e4b2-80f6-4fb5-a944-d74c66288350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Flow 'volume_create_manager' (4a2eed8a-95dd-437f-ae9b-89894ce50f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a1985295-8a14-49d8-886c-fd7bff53c82c tempest-VolumesTransfersTest-963387671 None] Created volume successfully.
Jul 31 14:53:55 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-13442610-1eed-4ee9-81ea-f5d4f3fa736c tempest-VolumesTransfersTest-1754491800 None] Transfer volume completed successfully.
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Acquiring lock "cinder-2b27152e-33c5-40ba-8e40-d199cbfb7952-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Lock "cinder-2b27152e-33c5-40ba-8e40-d199cbfb7952-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Acquiring lock "cinder-quobyte-2b27152e-33c5-40ba-8e40-d199cbfb7952" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Lock "cinder-quobyte-2b27152e-33c5-40ba-8e40-d199cbfb7952" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8f3de7-cef8-4341-873b-7203d2350b2c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:57 devstack sudo[95735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952
Jul 31 14:53:57 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:57 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952" returned: 0 in 0.496s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:57 devstack sudo[95740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952
Jul 31 14:53:57 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:57 devstack sudo[95742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:57 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:58 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2b27152e-33c5-40ba-8e40-d199cbfb7952" returned: 0 in 0.360s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Lock "cinder-quobyte-2b27152e-33c5-40ba-8e40-d199cbfb7952" released by "delete_volume" :: held 0.947s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Created reservations ['3c55d1a0-eaeb-43a2-9ae1-bff7dbe7c3b0', '8445aa9c-aeaf-42fd-85bc-345c1dcc4c57', 'ae78ff8d-69b7-46b1-b042-1910fa2af834', 'b15f5edd-c7b4-4c16-94ee-6bd560dd2883'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:58 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:53:58 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:53:58 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.723s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 8 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:53:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:53:59 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.593s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:53:59 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Deleted volume successfully.
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64b54199-196a-4976-a89c-31239e5eca1d tempest-VolumesTransfersTest-916733125 None] Lock "cinder-2b27152e-33c5-40ba-8e40-d199cbfb7952-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Flow 'volume_create_manager' (f8bb4b54-2db0-4bf5-8b93-01dac49df168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2386841e-4de2-4446-ba86-2bb9efcf2b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2386841e-4de2-4446-ba86-2bb9efcf2b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-430346190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b32ca8-9a2a-48bf-869e-8f209a210e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf6ef114724452941550d18ddb55b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:59Z,use_quota=True,user_id='0392d61bf8de45098f1b7c9a195ce35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a05a03-f023-48e9-b5c2-4868f4d600a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a05a03-f023-48e9-b5c2-4868f4d600a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7450d555-5991-45c4-8998-cc9e4264f079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7450d555-5991-45c4-8998-cc9e4264f079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b32ca8-9a2a-48bf-869e-8f209a210e71', 'volume_name': 'volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ceca4c-743d-4a0c-8549-0c4c7bcd6f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ceca4c-743d-4a0c-8549-0c4c7bcd6f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f947a3a0-34c0-4e0f-881a-8ae8d06e3e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:53:59 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Volume c4b32ca8-9a2a-48bf-869e-8f209a210e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71', 'volume_size': 1}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-430346190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b32ca8-9a2a-48bf-869e-8f209a210e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf6ef114724452941550d18ddb55b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:53:59Z,use_quota=True,user_id='0392d61bf8de45098f1b7c9a195ce35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Creating volume c4b32ca8-9a2a-48bf-869e-8f209a210e71 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:53:59 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:53:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:53:59 devstack sudo[95761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71 1073741824
Jul 31 14:53:59 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:00 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71 1073741824" returned: 0 in 0.772s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:00 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71
Jul 31 14:54:00 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:00 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71" returned: 0 in 0.373s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:54:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f947a3a0-34c0-4e0f-881a-8ae8d06e3e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5347b8d6-0cc4-490f-94a5-be070f4e8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:00 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Volume volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71 (c4b32ca8-9a2a-48bf-869e-8f209a210e71): created successfully
Jul 31 14:54:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5347b8d6-0cc4-490f-94a5-be070f4e8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Flow 'volume_create_manager' (f8bb4b54-2db0-4bf5-8b93-01dac49df168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:01 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8df814dc-2459-45c1-bdd0-adace764df30 tempest-VolumesTransfersTest-963387671 None] Created volume successfully.
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Acquiring lock "cinder-c4b32ca8-9a2a-48bf-869e-8f209a210e71-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Lock "cinder-c4b32ca8-9a2a-48bf-869e-8f209a210e71-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Acquiring lock "cinder-quobyte-c4b32ca8-9a2a-48bf-869e-8f209a210e71" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Lock "cinder-quobyte-c4b32ca8-9a2a-48bf-869e-8f209a210e71" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c999b-a72b-447c-9ad1-9f48b2d294d8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:02 devstack sudo[95781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71
Jul 31 14:54:02 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:02 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71" returned: 0 in 0.442s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:02 devstack sudo[95787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71
Jul 31 14:54:02 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:02 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c4b32ca8-9a2a-48bf-869e-8f209a210e71" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Lock "cinder-quobyte-c4b32ca8-9a2a-48bf-869e-8f209a210e71" released by "delete_volume" :: held 0.767s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Created reservations ['3c13d6e8-9ac1-4984-9598-dcf66634381f', '59f11772-abf3-4355-990f-ce1b667ad807', 'd69a4440-55c1-4f29-b5d9-c2a9d5a8b9f4', '663856a8-499f-4ea5-b22f-f2629b918e45'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:03 devstack sudo[95814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:54:03 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:03 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.282s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:54:03 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Deleted volume successfully.
Jul 31 14:54:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b2e2f153-8d97-4454-bd46-33f52ceed647 tempest-VolumesTransfersTest-916733125 None] Lock "cinder-c4b32ca8-9a2a-48bf-869e-8f209a210e71-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:54:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-61e6ddc2-7b4b-489d-8879-330dbabbad63 req-ffe6211b-857c-4941-b1c6-16acb44a29b5 tempest-AttachVolumeTestJSON-506879225 None] Terminate volume connection completed successfully.
Jul 31 14:54:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-61e6ddc2-7b4b-489d-8879-330dbabbad63 req-ffe6211b-857c-4941-b1c6-16acb44a29b5 tempest-AttachVolumeTestJSON-506879225 None] Deleting attachment 1729076b-e87f-4e11-93bc-326145c1e42c. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=77,cinder:UPDATE=107,cinder:INSERT=22,cinder:DELETE=7 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:DELETE=11,cinder:SELECT=79,cinder:UPDATE=101,cinder:INSERT=26 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Flow 'volume_create_manager' (61e6d2b8-cfdb-4cc6-89de-98bf646446e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1f7acb-b03f-447e-911d-029602bae00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1f7acb-b03f-447e-911d-029602bae00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-88098921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3458f2-0c22-4979-894b-7d71fa75f66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b42873e78fa64ebda4ac0a0a3ffb61d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:15Z,use_quota=True,user_id='52904da596af4b4b9e655ab9567834a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f530da48-f2ed-4912-aed0-713853a358e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f530da48-f2ed-4912-aed0-713853a358e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4e7a10-2095-4e51-adcb-2c47773c3ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4e7a10-2095-4e51-adcb-2c47773c3ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3458f2-0c22-4979-894b-7d71fa75f66a', 'volume_name': 'volume-4b3458f2-0c22-4979-894b-7d71fa75f66a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b29c602-4027-4bd7-8bb9-8fe4d4059253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b29c602-4027-4bd7-8bb9-8fe4d4059253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc052a91-c3bb-4fdb-a07b-373d20bc9d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:15 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Volume 4b3458f2-0c22-4979-894b-7d71fa75f66a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3458f2-0c22-4979-894b-7d71fa75f66a', 'volume_size': 1}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-88098921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3458f2-0c22-4979-894b-7d71fa75f66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b42873e78fa64ebda4ac0a0a3ffb61d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:15Z,use_quota=True,user_id='52904da596af4b4b9e655ab9567834a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Creating volume 4b3458f2-0c22-4979-894b-7d71fa75f66a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:54:15 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:15 devstack sudo[95946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a 1073741824
Jul 31 14:54:15 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:15 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a 1073741824" returned: 0 in 0.614s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:16 devstack sudo[95981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a
Jul 31 14:54:16 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:16 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a" returned: 0 in 0.351s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:54:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc052a91-c3bb-4fdb-a07b-373d20bc9d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3458f2-0c22-4979-894b-7d71fa75f66a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46118439-d023-4303-9604-4daa0cfa031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:16 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Volume volume-4b3458f2-0c22-4979-894b-7d71fa75f66a (4b3458f2-0c22-4979-894b-7d71fa75f66a): created successfully
Jul 31 14:54:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46118439-d023-4303-9604-4daa0cfa031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Flow 'volume_create_manager' (61e6d2b8-cfdb-4cc6-89de-98bf646446e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6b1e1f0d-42a3-4c9e-a889-9a50235c7cbd tempest-VolumesTransfersV357Test-1128273135 None] Created volume successfully.
Jul 31 14:54:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-91f9c42e-ddd2-4ed2-81ae-52fb6eba72f4 tempest-VolumesTransfersV357Test-155674141 None] Transfer volume completed successfully.
Jul 31 14:54:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Acquiring lock "cinder-4b3458f2-0c22-4979-894b-7d71fa75f66a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:54:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-4b3458f2-0c22-4979-894b-7d71fa75f66a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:54:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Acquiring lock "cinder-quobyte-4b3458f2-0c22-4979-894b-7d71fa75f66a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:54:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-quobyte-4b3458f2-0c22-4979-894b-7d71fa75f66a" acquired by "delete_volume" :: waited 0.050s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:54:19 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[853381dd-ad3a-4faf-9040-b4e52a8171e8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:54:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:19 devstack sudo[96039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a
Jul 31 14:54:19 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:20 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a" returned: 0 in 1.026s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:20 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a
Jul 31 14:54:20 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:21 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b3458f2-0c22-4979-894b-7d71fa75f66a" returned: 0 in 0.614s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-quobyte-4b3458f2-0c22-4979-894b-7d71fa75f66a" released by "delete_volume" :: held 1.757s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Created reservations ['d82b34b9-e747-406b-b501-c1ab0f93379d', '4114a11d-6306-4c27-abd1-1fce5960d42e', 'a68b6732-329d-4e31-a4d3-c27b74cab1a8', '76e51bce-5bb0-49af-b6d9-de358571054d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:21 devstack sudo[96098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:54:21 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:22 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.625s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:22 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:54:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Deleted volume successfully.
Jul 31 14:54:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cd0994d9-0947-4d20-8fea-4a6e480b8436 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-4b3458f2-0c22-4979-894b-7d71fa75f66a-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Flow 'volume_create_manager' (b3f62618-c73d-4bb0-8c0d-2ead452a87a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f37f5de-6d15-4a17-a3ca-e66e1873a3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f37f5de-6d15-4a17-a3ca-e66e1873a3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1123446581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c437de72-6a24-4023-b846-d6dac1832bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b42873e78fa64ebda4ac0a0a3ffb61d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:23Z,use_quota=True,user_id='52904da596af4b4b9e655ab9567834a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f946cf-004a-4633-8ea6-ec67c4523374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f946cf-004a-4633-8ea6-ec67c4523374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f339b0d-088f-49e9-bd24-ecbf8ba5daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f339b0d-088f-49e9-bd24-ecbf8ba5daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c437de72-6a24-4023-b846-d6dac1832bcb', 'volume_name': 'volume-c437de72-6a24-4023-b846-d6dac1832bcb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addf1f58-ada3-4388-b417-9b2ca812f59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addf1f58-ada3-4388-b417-9b2ca812f59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28c6fdc-84d2-41cd-a730-539f80681bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Volume c437de72-6a24-4023-b846-d6dac1832bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c437de72-6a24-4023-b846-d6dac1832bcb', 'volume_size': 1}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1123446581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c437de72-6a24-4023-b846-d6dac1832bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b42873e78fa64ebda4ac0a0a3ffb61d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:23Z,use_quota=True,user_id='52904da596af4b4b9e655ab9567834a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Creating volume c437de72-6a24-4023-b846-d6dac1832bcb {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:54:23 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:54:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:23 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb 1073741824
Jul 31 14:54:23 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:24 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb 1073741824" returned: 0 in 1.066s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:24 devstack sudo[96113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb
Jul 31 14:54:24 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:25 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb" returned: 0 in 0.602s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:54:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28c6fdc-84d2-41cd-a730-539f80681bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c437de72-6a24-4023-b846-d6dac1832bcb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeba639c-1141-4da0-812e-880c5fc53c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Volume volume-c437de72-6a24-4023-b846-d6dac1832bcb (c437de72-6a24-4023-b846-d6dac1832bcb): created successfully
Jul 31 14:54:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeba639c-1141-4da0-812e-880c5fc53c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Flow 'volume_create_manager' (b3f62618-c73d-4bb0-8c0d-2ead452a87a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3487eab1-8a42-4be3-b4db-9fad70167327 tempest-VolumesTransfersV357Test-1128273135 None] Created volume successfully.
Jul 31 14:54:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Acquiring lock "cinder-c437de72-6a24-4023-b846-d6dac1832bcb-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:54:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-c437de72-6a24-4023-b846-d6dac1832bcb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:54:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Acquiring lock "cinder-quobyte-c437de72-6a24-4023-b846-d6dac1832bcb" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:54:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-quobyte-c437de72-6a24-4023-b846-d6dac1832bcb" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:54:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca78ea23-c7ad-4d58-8d9f-b1c295d6bfea]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:54:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:26 devstack sudo[96120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb
Jul 31 14:54:26 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:27 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb" returned: 0 in 0.737s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:27 devstack sudo[96126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb
Jul 31 14:54:27 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:27 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c437de72-6a24-4023-b846-d6dac1832bcb" returned: 0 in 0.548s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-quobyte-c437de72-6a24-4023-b846-d6dac1832bcb" released by "delete_volume" :: held 1.374s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Created reservations ['ecf7c10c-b8db-4f59-8765-24834fc2577f', '80c6da0b-2d90-49ff-af8c-f1cb5ca05b91', '553fd00d-b511-4b06-9518-950b9c3dba75', '4ae28d5d-a8ca-4ed5-87bb-61010298c971'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:28 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:54:28 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:28 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.598s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:54:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Deleted volume successfully.
Jul 31 14:54:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a89bc648-7fb0-4ec7-b96d-6e83b80503c1 tempest-VolumesTransfersV357Test-487445258 None] Lock "cinder-c437de72-6a24-4023-b846-d6dac1832bcb-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Flow 'volume_create_manager' (295501cc-b1c0-4d9d-b378-21c129762691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa6ed50-5b2e-4f96-b2ce-9054c8939c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa6ed50-5b2e-4f96-b2ce-9054c8939c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1951703781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c25138-3080-435b-9119-dd807e577425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4cf27713ac40f6982b1c2f09083dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:30Z,use_quota=True,user_id='cdac207b206442679d395f3b56c2a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1f2fb8-cb1c-491c-b909-5824939e3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1f2fb8-cb1c-491c-b909-5824939e3050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be801f60-8ada-4817-b292-6de6023028b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be801f60-8ada-4817-b292-6de6023028b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c25138-3080-435b-9119-dd807e577425', 'volume_name': 'volume-f9c25138-3080-435b-9119-dd807e577425', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdc4036-1554-40f4-b9c0-d8a9ea280a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdc4036-1554-40f4-b9c0-d8a9ea280a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2614747d-4442-457c-ba7b-25419ebab3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Volume f9c25138-3080-435b-9119-dd807e577425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c25138-3080-435b-9119-dd807e577425', 'volume_size': 1}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1951703781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c25138-3080-435b-9119-dd807e577425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4cf27713ac40f6982b1c2f09083dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:30Z,use_quota=True,user_id='cdac207b206442679d395f3b56c2a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Creating volume f9c25138-3080-435b-9119-dd807e577425 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:54:30 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:30 devstack sudo[96133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425 1073741824
Jul 31 14:54:30 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Flow 'volume_create_manager' (3bd1ce66-f2df-4f4e-894c-ad56e30b0a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5dbe708-d5d6-4b3c-a2ff-e3a7c76b7a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5dbe708-d5d6-4b3c-a2ff-e3a7c76b7a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1284049236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299f3fe6-3437-4f6a-be32-31eb1cfab919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4cf27713ac40f6982b1c2f09083dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:31Z,use_quota=True,user_id='cdac207b206442679d395f3b56c2a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390127a-8686-4904-9f83-412459f31859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390127a-8686-4904-9f83-412459f31859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b4c1e-cc9b-45ff-8b65-bade107c5800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b4c1e-cc9b-45ff-8b65-bade107c5800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299f3fe6-3437-4f6a-be32-31eb1cfab919', 'volume_name': 'volume-299f3fe6-3437-4f6a-be32-31eb1cfab919', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2c326a-fe8f-4e68-8f5e-b2fcb55a8a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2c326a-fe8f-4e68-8f5e-b2fcb55a8a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff83405c-a93d-4d00-8e53-14ce1890d12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Volume 299f3fe6-3437-4f6a-be32-31eb1cfab919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299f3fe6-3437-4f6a-be32-31eb1cfab919', 'volume_size': 1}
Jul 31 14:54:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:31 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425 1073741824" returned: 0 in 1.190s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:31 devstack sudo[96162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425
Jul 31 14:54:31 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:31 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425" returned: 0 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1284049236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299f3fe6-3437-4f6a-be32-31eb1cfab919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4cf27713ac40f6982b1c2f09083dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:31Z,use_quota=True,user_id='cdac207b206442679d395f3b56c2a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Creating volume 299f3fe6-3437-4f6a-be32-31eb1cfab919 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:54:31 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2614747d-4442-457c-ba7b-25419ebab3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c25138-3080-435b-9119-dd807e577425', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:31 devstack sudo[96165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919 1073741824
Jul 31 14:54:31 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c5a34-6789-4418-9e04-05273c3745b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Volume volume-f9c25138-3080-435b-9119-dd807e577425 (f9c25138-3080-435b-9119-dd807e577425): created successfully
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c5a34-6789-4418-9e04-05273c3745b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Flow 'volume_create_manager' (295501cc-b1c0-4d9d-b378-21c129762691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-35040b7f-4d60-4a79-a54c-61c2e5ff0f25 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Created volume successfully.
Jul 31 14:54:32 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919 1073741824" returned: 0 in 0.740s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:32 devstack sudo[96172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919
Jul 31 14:54:32 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:32 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff83405c-a93d-4d00-8e53-14ce1890d12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299f3fe6-3437-4f6a-be32-31eb1cfab919', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a07312-25ec-4a11-a606-d1505f3790b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:32 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Volume volume-299f3fe6-3437-4f6a-be32-31eb1cfab919 (299f3fe6-3437-4f6a-be32-31eb1cfab919): created successfully
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a07312-25ec-4a11-a606-d1505f3790b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Flow 'volume_create_manager' (3bd1ce66-f2df-4f4e-894c-ad56e30b0a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6cc3f694-5d1e-4518-b6d7-782b7cce5f1b tempest-TestServerVolumeAttachmentScenario-1602704306 None] Created volume successfully.
Jul 31 14:54:42 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:54:42 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=19,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=4 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:54:43 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:54:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Flow 'volume_create_manager' (42c6026a-fff3-4ee0-95ba-b15c6d2e206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b269018d-1f83-4c5e-9b3d-103f592cc525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b269018d-1f83-4c5e-9b3d-103f592cc525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-439405401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94e77a2947042f29eae53b669c15b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:44Z,use_quota=True,user_id='9b51a90105b94fc4a3dfa0ffe6710cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e54b43-37e6-40be-84c3-ad59fdadfbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e54b43-37e6-40be-84c3-ad59fdadfbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9692d125-7973-4d06-9d84-3fc7adfd9069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9692d125-7973-4d06-9d84-3fc7adfd9069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d', 'volume_name': 'volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7647b21-d6de-416a-a84a-6d7dc4b392c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7647b21-d6de-416a-a84a-6d7dc4b392c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eb16d5-5f62-48ea-b3e7-ddb1086ab3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:44 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Volume b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d', 'volume_size': 1}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-439405401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94e77a2947042f29eae53b669c15b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:44Z,use_quota=True,user_id='9b51a90105b94fc4a3dfa0ffe6710cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Creating volume b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:54:44 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:54:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:44 devstack sudo[96289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d 1073741824
Jul 31 14:54:44 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:44 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d 1073741824" returned: 0 in 0.816s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:45 devstack sudo[96295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d
Jul 31 14:54:45 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:45 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d" returned: 0 in 0.329s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eb16d5-5f62-48ea-b3e7-ddb1086ab3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293d8aab-dd23-4f12-8bb9-78994e01b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:45 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Volume volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d (b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d): created successfully
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293d8aab-dd23-4f12-8bb9-78994e01b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Flow 'volume_create_manager' (42c6026a-fff3-4ee0-95ba-b15c6d2e206c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7b29cdb5-160e-4a33-8f1e-605857c59cf2 tempest-AttachVolumeNegativeTest-1661374885 None] Created volume successfully.
Jul 31 14:54:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-71499874-c552-4630-8a89-11a60eff1243 req-6a4e3486-7700-46f4-be1d-f23af4c25a33 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-71499874-c552-4630-8a89-11a60eff1243 req-6a4e3486-7700-46f4-be1d-f23af4c25a33 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-71499874-c552-4630-8a89-11a60eff1243 req-6a4e3486-7700-46f4-be1d-f23af4c25a33 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-71499874-c552-4630-8a89-11a60eff1243 req-6a4e3486-7700-46f4-be1d-f23af4c25a33 tempest-AttachVolumeNegativeTest-1661374885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f4f33c4-da93-42be-9ee4-fdaf18f3c2c6', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:54:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-71499874-c552-4630-8a89-11a60eff1243 req-6a4e3486-7700-46f4-be1d-f23af4c25a33 tempest-AttachVolumeNegativeTest-1661374885 None] attachment_update completed successfully.
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Flow 'volume_create_manager' (ca9dd803-988e-40f4-9638-3951f335a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f67c0b8-c735-43b2-b15b-148e1ab00255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f67c0b8-c735-43b2-b15b-148e1ab00255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193981137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5f6b8-6c99-4444-a3f4-8190f2f9d89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e08451818d4efd9667771fb9da8f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:52Z,use_quota=True,user_id='60e4934a4a52486d9f1655311be7e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22eff1c-7343-4f7f-8361-8a43aa9ac3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22eff1c-7343-4f7f-8361-8a43aa9ac3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7078ca32-ee39-49bc-be4a-a9a9f4023e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7078ca32-ee39-49bc-be4a-a9a9f4023e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d5f6b8-6c99-4444-a3f4-8190f2f9d89b', 'volume_name': 'volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea85c851-97be-4cc8-873f-fe56cbbdfa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea85c851-97be-4cc8-873f-fe56cbbdfa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d9eeb4-f288-46d4-9681-ef6b1b051a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:52 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Volume 76d5f6b8-6c99-4444-a3f4-8190f2f9d89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b', 'volume_size': 1}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193981137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5f6b8-6c99-4444-a3f4-8190f2f9d89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e08451818d4efd9667771fb9da8f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:54:52Z,use_quota=True,user_id='60e4934a4a52486d9f1655311be7e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Creating volume 76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:54:52 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:54:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:52 devstack sudo[96728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b 1073741824
Jul 31 14:54:52 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:53 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b 1073741824" returned: 0 in 0.704s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:53 devstack sudo[96736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:54:53 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:53 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d9eeb4-f288-46d4-9681-ef6b1b051a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11244cf2-5e76-454a-a70a-36b384211879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:54:53 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Volume volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b (76d5f6b8-6c99-4444-a3f4-8190f2f9d89b): created successfully
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11244cf2-5e76-454a-a70a-36b384211879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:54:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Flow 'volume_create_manager' (ca9dd803-988e-40f4-9638-3951f335a182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:54:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-43f9f264-3104-4c2c-9bee-4617023d5905 tempest-VolumesActionsTest-1721591294 None] Created volume successfully.
Jul 31 14:54:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:54:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:54:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:54:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:54:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:54:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:54:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:54:57 devstack sudo[96794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:54:57 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:54:58 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root
Jul 31 14:54:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.321s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:54:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:54:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:54:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 8 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:54:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:55:03 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=8,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:55:03 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:55:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c2f4e0b-485a-426a-a716-f8f9b04fc3a3 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" by "attach_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c2f4e0b-485a-426a-a716-f8f9b04fc3a3 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" acquired by "attach_volume" :: waited 0.060s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9c2f4e0b-485a-426a-a716-f8f9b04fc3a3 tempest-VolumesActionsTest-1721591294 None] Attaching volume 76d5f6b8-6c99-4444-a3f4-8190f2f9d89b to instance 7bc9a644-898e-4d36-9d7d-3d406ede91b8 at mountpoint /dev/vdb on host None.
Jul 31 14:55:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9c2f4e0b-485a-426a-a716-f8f9b04fc3a3 tempest-VolumesActionsTest-1721591294 None] Attach volume completed successfully.
Jul 31 14:55:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9c2f4e0b-485a-426a-a716-f8f9b04fc3a3 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" released by "attach_volume" :: held 0.342s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-14177ecb-2c98-4dcd-8ae7-52725f3e9fa4 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-detach_volume" by "detach_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-14177ecb-2c98-4dcd-8ae7-52725f3e9fa4 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-detach_volume" acquired by "detach_volume" :: waited 0.119s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-14177ecb-2c98-4dcd-8ae7-52725f3e9fa4 tempest-VolumesActionsTest-1721591294 None] Detaching volume 76d5f6b8-6c99-4444-a3f4-8190f2f9d89b from instance 7bc9a644-898e-4d36-9d7d-3d406ede91b8.
Jul 31 14:55:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-14177ecb-2c98-4dcd-8ae7-52725f3e9fa4 tempest-VolumesActionsTest-1721591294 None] Detach volume completed successfully.
Jul 31 14:55:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-14177ecb-2c98-4dcd-8ae7-52725f3e9fa4 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-detach_volume" released by "detach_volume" :: held 0.495s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ab8998f4-6565-4d47-9911-1ba7e38d7487 req-8a5736cf-b2e7-4af3-bac2-9f36c528a110 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:55:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ab8998f4-6565-4d47-9911-1ba7e38d7487 req-8a5736cf-b2e7-4af3-bac2-9f36c528a110 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:55:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ab8998f4-6565-4d47-9911-1ba7e38d7487 req-8a5736cf-b2e7-4af3-bac2-9f36c528a110 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.094s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:55:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-ab8998f4-6565-4d47-9911-1ba7e38d7487 req-8a5736cf-b2e7-4af3-bac2-9f36c528a110 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-f9c25138-3080-435b-9119-dd807e577425', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34257180-8d51-447f-a0e6-0e02f2c2cca4', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:55:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-ab8998f4-6565-4d47-9911-1ba7e38d7487 req-8a5736cf-b2e7-4af3-bac2-9f36c528a110 tempest-TestServerVolumeAttachmentScenario-1602704306 None] attachment_update completed successfully.
Jul 31 14:55:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-5e1336c5-24e9-4336-84c0-a3fc02ed3782 req-ec4c1508-1aae-4e3f-93c6-2816ce956e87 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:55:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-5e1336c5-24e9-4336-84c0-a3fc02ed3782 req-ec4c1508-1aae-4e3f-93c6-2816ce956e87 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:55:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-5e1336c5-24e9-4336-84c0-a3fc02ed3782 req-ec4c1508-1aae-4e3f-93c6-2816ce956e87 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:55:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-5e1336c5-24e9-4336-84c0-a3fc02ed3782 req-ec4c1508-1aae-4e3f-93c6-2816ce956e87 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-299f3fe6-3437-4f6a-be32-31eb1cfab919', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9900d547-74ee-4e21-a8f5-7bfb1fcbfa2a', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:55:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-5e1336c5-24e9-4336-84c0-a3fc02ed3782 req-ec4c1508-1aae-4e3f-93c6-2816ce956e87 tempest-TestServerVolumeAttachmentScenario-1602704306 None] attachment_update completed successfully.
Jul 31 14:55:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-7a17ffa2-c11e-4c68-9ae5-e43c822ebe23 req-edd6a241-9568-495f-921d-0bf3ca02d610 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Terminate volume connection completed successfully.
Jul 31 14:55:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-7a17ffa2-c11e-4c68-9ae5-e43c822ebe23 req-edd6a241-9568-495f-921d-0bf3ca02d610 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Deleting attachment 9900d547-74ee-4e21-a8f5-7bfb1fcbfa2a. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:55:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-c09408ad-fe40-49b3-8120-90d37a581fb6 req-e83340e4-f00e-4520-b63c-beeedc5a7716 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Terminate volume connection completed successfully.
Jul 31 14:55:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-c09408ad-fe40-49b3-8120-90d37a581fb6 req-e83340e4-f00e-4520-b63c-beeedc5a7716 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Deleting attachment 34257180-8d51-447f-a0e6-0e02f2c2cca4. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:55:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1417e3f9-c883-41d7-b1e6-b87d25fc5390 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" by "attach_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1417e3f9-c883-41d7-b1e6-b87d25fc5390 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" acquired by "attach_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1417e3f9-c883-41d7-b1e6-b87d25fc5390 tempest-VolumesActionsTest-1721591294 None] Attaching volume 76d5f6b8-6c99-4444-a3f4-8190f2f9d89b to instance f01603ba-d4ac-416a-a926-a6fe0ff0d778 at mountpoint /dev/vdb on host None.
Jul 31 14:55:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1417e3f9-c883-41d7-b1e6-b87d25fc5390 tempest-VolumesActionsTest-1721591294 None] Attach volume completed successfully.
Jul 31 14:55:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1417e3f9-c883-41d7-b1e6-b87d25fc5390 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" released by "attach_volume" :: held 0.274s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-edf24e8b-4ceb-45ac-8ce9-b8a2d4e59d96 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-detach_volume" by "detach_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-edf24e8b-4ceb-45ac-8ce9-b8a2d4e59d96 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-edf24e8b-4ceb-45ac-8ce9-b8a2d4e59d96 tempest-VolumesActionsTest-1721591294 None] Detaching volume 76d5f6b8-6c99-4444-a3f4-8190f2f9d89b from instance f01603ba-d4ac-416a-a926-a6fe0ff0d778.
Jul 31 14:55:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-edf24e8b-4ceb-45ac-8ce9-b8a2d4e59d96 tempest-VolumesActionsTest-1721591294 None] Detach volume completed successfully.
Jul 31 14:55:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-edf24e8b-4ceb-45ac-8ce9-b8a2d4e59d96 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "cinder-299f3fe6-3437-4f6a-be32-31eb1cfab919-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-299f3fe6-3437-4f6a-be32-31eb1cfab919-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "cinder-quobyte-299f3fe6-3437-4f6a-be32-31eb1cfab919" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-quobyte-299f3fe6-3437-4f6a-be32-31eb1cfab919" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af42c2-a4c2-416c-a3e9-2d2a47957392]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:55:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:33 devstack sudo[97908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919
Jul 31 14:55:33 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:34 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919" returned: 0 in 0.520s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:34 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919
Jul 31 14:55:34 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:34 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-299f3fe6-3437-4f6a-be32-31eb1cfab919" returned: 0 in 0.275s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-quobyte-299f3fe6-3437-4f6a-be32-31eb1cfab919" released by "delete_volume" :: held 0.875s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Created reservations ['a5ef8136-310f-4ada-aee0-a9190366e117', 'aa83fa86-aad4-43c7-bf8a-3ca560d6e463', '06cd0c97-08b2-441d-832c-1745546a5f56', '4b2fbf79-fbb4-4883-b8b8-5d7d247b5970'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:34 devstack sudo[97919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:55:34 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "cinder-f9c25138-3080-435b-9119-dd807e577425-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-f9c25138-3080-435b-9119-dd807e577425-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "cinder-quobyte-f9c25138-3080-435b-9119-dd807e577425" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-quobyte-f9c25138-3080-435b-9119-dd807e577425" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d59c15f-206c-4f7b-ae34-be3e430b05ee]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:55:34 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc5132c-4e06-42d3-82cc-f465d01bbf39]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:55:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Deleted volume successfully.
Jul 31 14:55:34 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425
Jul 31 14:55:34 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d6ee20fe-a3e9-42f7-8ffd-16cf0bda98b8 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-299f3fe6-3437-4f6a-be32-31eb1cfab919-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:35 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:55:35 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:35 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425" returned: 0 in 0.473s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:35 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425
Jul 31 14:55:35 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:35 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.443s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0b32b-00a6-42aa-b4b0-e55c6c96484a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:35 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:55:35 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:35 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f9c25138-3080-435b-9119-dd807e577425" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-quobyte-f9c25138-3080-435b-9119-dd807e577425" released by "delete_volume" :: held 0.833s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Created reservations ['c018767a-108e-49a3-bbf3-62d4776e775c', '9e70ff8b-0eb2-4dbc-b003-bd2856388db2', '09a634ac-556f-4777-a289-fb785796d9fc', '91eabd3c-0e0f-41d0-8fe2-53a3b6cdbbf1'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:35 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:55:35 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:35 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.450s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.1ce586a0-3035-478c-9e07-77bb709373468gkn0w63.img {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:35 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.1ce586a0-3035-478c-9e07-77bb709373468gkn0w63.img
Jul 31 14:55:35 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:36 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.359s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:36 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:55:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Deleted volume successfully.
Jul 31 14:55:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-239bc4e1-454d-4f47-aeef-11f2ef5109f0 tempest-TestServerVolumeAttachmentScenario-1602704306 None] Lock "cinder-f9c25138-3080-435b-9119-dd807e577425-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:55:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-bd4d0afe-9787-4be4-bc97-65ff048afe3f req-a53be82e-f013-4f44-a3b7-34d78a8c34a6 tempest-AttachVolumeNegativeTest-1661374885 None] Terminate volume connection completed successfully.
Jul 31 14:55:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-bd4d0afe-9787-4be4-bc97-65ff048afe3f req-a53be82e-f013-4f44-a3b7-34d78a8c34a6 tempest-AttachVolumeNegativeTest-1661374885 None] Deleting attachment 3f4f33c4-da93-42be-9ee4-fdaf18f3c2c6. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:55:40 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:55:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Flow 'volume_create_manager' (081db9a0-1069-4525-ab64-1a67177e863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:55:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a78e6f-0070-4508-9f4c-92ee1c44bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:55:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a78e6f-0070-4508-9f4c-92ee1c44bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-828981730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aea72f7-bca1-4cd7-993b-5015cec4db13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f3504e9c80412a8a36f9caf978be12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:55:41Z,use_quota=True,user_id='44c965e7e06746b99bdd278cb9211175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870c30c5-4d5f-4c7a-850f-2c2905967948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870c30c5-4d5f-4c7a-850f-2c2905967948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255c77ce-ac4f-4da8-80fa-edca33f3b0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255c77ce-ac4f-4da8-80fa-edca33f3b0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aea72f7-bca1-4cd7-993b-5015cec4db13', 'volume_name': 'volume-0aea72f7-bca1-4cd7-993b-5015cec4db13', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b125fafb-7ef5-4a9f-9ecc-a937edf79be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b125fafb-7ef5-4a9f-9ecc-a937edf79be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05306673-c85f-474c-8b10-032eaa64288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:55:41 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Volume 0aea72f7-bca1-4cd7-993b-5015cec4db13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aea72f7-bca1-4cd7-993b-5015cec4db13', 'volume_size': 1}
Jul 31 14:55:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:55:42 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.1ce586a0-3035-478c-9e07-77bb709373468gkn0w63.img" returned: 0 in 6.594s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:42 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff49909c-36b9-4ec3-ac34-bd0fab838d04]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:55:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:42 devstack sudo[97991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:55:42 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:43 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.694s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:43 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.1ce586a0-3035-478c-9e07-77bb709373468gkn0w63.img {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:55:43 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Converted 1024.00 MB image at 155.26 MB/s
Jul 31 14:55:43 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] 1ce586a0-3035-478c-9e07-77bb70937346 was raw, no need to convert to raw {{(pid=88594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 31 14:55:50 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:INSERT=3,cinder:SELECT=39,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:55:53 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=44,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:55:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:55:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:55:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:55:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:55:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:55:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:55:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:55:58 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:55:58 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:55:58 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Jul 31 14:55:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.513s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:55:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:55:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:55:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:55:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:56:08 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:56:08 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.543s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Uploaded volume to glance image-id: 1ce586a0-3035-478c-9e07-77bb70937346. {{(pid=88594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.389s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-828981730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aea72f7-bca1-4cd7-993b-5015cec4db13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f3504e9c80412a8a36f9caf978be12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:55:41Z,use_quota=True,user_id='44c965e7e06746b99bdd278cb9211175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Creating volume 0aea72f7-bca1-4cd7-993b-5015cec4db13 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:56:12 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:12 devstack sudo[98214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13 1073741824
Jul 31 14:56:12 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d3fb6016-5b05-42e9-abcc-f6836a210b16 tempest-VolumesActionsTest-1721591294 None] Copy volume to image completed successfully.
Jul 31 14:56:12 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13 1073741824" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:12 devstack sudo[98220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13
Jul 31 14:56:12 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:13 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:56:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05306673-c85f-474c-8b10-032eaa64288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aea72f7-bca1-4cd7-993b-5015cec4db13', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d426c4-0f83-4149-8b50-432760efe076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:13 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Volume volume-0aea72f7-bca1-4cd7-993b-5015cec4db13 (0aea72f7-bca1-4cd7-993b-5015cec4db13): created successfully
Jul 31 14:56:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d426c4-0f83-4149-8b50-432760efe076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Flow 'volume_create_manager' (081db9a0-1069-4525-ab64-1a67177e863d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-77be0c1e-200d-450c-aa38-ba039f039ffc tempest-AttachVolumeTestJSON-506879225 None] Created volume successfully.
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d169f0c-02b5-4d47-acfc-242b68523613]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:14 devstack sudo[98227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:56:14 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-f3616439-ce1b-4977-92aa-72652120e221 req-87248d5d-be09-4bb5-8a56-0fbf51cec16d tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:14 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.411s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[29648c5a-6a92-476e-a3b8-089a172fe912]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:14 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:56:14 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:15 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.367s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:15 devstack sudo[98245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img
Jul 31 14:56:15 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:20 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img" returned: 0 in 5.429s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:20 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee8c4bf-963a-4f64-b83a-f3418b9b4a0c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:20 devstack sudo[98259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:56:20 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:21 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.546s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:56:21 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Converted 1024.00 MB image at 188.57 MB/s
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] cf231d36-1c4e-4ebc-8b3f-6ba322efb1af was raw, converting to qcow2 {{(pid=88594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6be43-231c-454a-897f-9af3dd175a78]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:21 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img
Jul 31 14:56:21 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:21 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img" returned: 0 in 0.386s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:21 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img
Jul 31 14:56:21 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:21 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img" returned: 1 in 0.347s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 14:56:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img /opt/stack/data/cinder/conversion/vol_upload_2j9z0exq {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:21 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img /opt/stack/data/cinder/conversion/vol_upload_2j9z0exq
Jul 31 14:56:21 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:22 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img /opt/stack/data/cinder/conversion/vol_upload_2j9z0exq" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:22 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Image conversion details: src /opt/stack/data/cinder/conversion/76d5f6b8-6c99-4444-a3f4-8190f2f9d89b.temp_image.cf231d36-1c4e-4ebc-8b3f-6ba322efb1af4sxh1wh9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2j9z0exq {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:56:22 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 31 14:56:22 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f0f7d-27ef-47e5-9627-ac27fa742cb0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2j9z0exq {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:22 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2j9z0exq
Jul 31 14:56:22 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:22 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2j9z0exq" returned: 0 in 0.422s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Flow 'volume_create_manager' (364eb3ec-d2dc-49b4-bc27-1f0d17900d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c0f9c-2a3f-48a2-ae74-46ee64a23cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c0f9c-2a3f-48a2-ae74-46ee64a23cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1779182368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174006d0-b1a4-4a20-bd55-bcfe1e9cda6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94e77a2947042f29eae53b669c15b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:23Z,use_quota=True,user_id='9b51a90105b94fc4a3dfa0ffe6710cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11ce1db-7b35-4cdb-a33f-6fba8fe972af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11ce1db-7b35-4cdb-a33f-6fba8fe972af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d06a7c-4a66-496e-a2d7-7ef96c703837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d06a7c-4a66-496e-a2d7-7ef96c703837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174006d0-b1a4-4a20-bd55-bcfe1e9cda6e', 'volume_name': 'volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7936fb7-6a55-4eae-8590-12eef665323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7936fb7-6a55-4eae-8590-12eef665323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b08172-fcf6-40b1-bfe3-feb963edfdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Volume 174006d0-b1a4-4a20-bd55-bcfe1e9cda6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e', 'volume_size': 1}
Jul 31 14:56:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.304s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Uploaded volume to glance image-id: cf231d36-1c4e-4ebc-8b3f-6ba322efb1af. {{(pid=88594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-f3616439-ce1b-4977-92aa-72652120e221 req-87248d5d-be09-4bb5-8a56-0fbf51cec16d tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-f3616439-ce1b-4977-92aa-72652120e221 req-87248d5d-be09-4bb5-8a56-0fbf51cec16d tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:24 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e562317b-cae3-4753-bc41-bf900b5278a1 tempest-VolumesActionsTest-1721591294 None] Copy volume to image completed successfully.
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1779182368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174006d0-b1a4-4a20-bd55-bcfe1e9cda6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94e77a2947042f29eae53b669c15b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:23Z,use_quota=True,user_id='9b51a90105b94fc4a3dfa0ffe6710cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Creating volume 174006d0-b1a4-4a20-bd55-bcfe1e9cda6e {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:56:24 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:24 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e 1073741824
Jul 31 14:56:24 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-f3616439-ce1b-4977-92aa-72652120e221 req-87248d5d-be09-4bb5-8a56-0fbf51cec16d tempest-AttachVolumeTestJSON-506879225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-0aea72f7-bca1-4cd7-993b-5015cec4db13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61bdf447-37d4-4cbc-95a6-32ba9baaea99', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:56:24 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-f3616439-ce1b-4977-92aa-72652120e221 req-87248d5d-be09-4bb5-8a56-0fbf51cec16d tempest-AttachVolumeTestJSON-506879225 None] attachment_update completed successfully.
Jul 31 14:56:25 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e 1073741824" returned: 0 in 0.724s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:25 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e
Jul 31 14:56:25 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Flow 'volume_create_manager' (5d865e41-6915-4f4a-9c87-d594f8bb030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9658b6a2-0ada-462c-b1c5-d22400f90cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9658b6a2-0ada-462c-b1c5-d22400f90cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1165261246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caec77b-0a6d-4552-8cd8-239dcabc8e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34bddbb724245ffa2f8487993ce26ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:25Z,use_quota=True,user_id='a16566db7c544a708312dd74b6c12fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ec939c-9ece-49dd-8e71-9d02f72b0c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ec939c-9ece-49dd-8e71-9d02f72b0c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa91d668-a704-4a32-8db0-ab5ec7d0646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa91d668-a704-4a32-8db0-ab5ec7d0646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9caec77b-0a6d-4552-8cd8-239dcabc8e71', 'volume_name': 'volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ea0de8-a76d-4fc9-a06a-ccf012f6ce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ea0de8-a76d-4fc9-a06a-ccf012f6ce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba880e94-4a5b-4a4f-8313-6a08b3cacfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Volume 9caec77b-0a6d-4552-8cd8-239dcabc8e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71', 'volume_size': 1}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:25 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e" returned: 0 in 0.295s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1165261246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caec77b-0a6d-4552-8cd8-239dcabc8e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34bddbb724245ffa2f8487993ce26ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:25Z,use_quota=True,user_id='a16566db7c544a708312dd74b6c12fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Creating volume 9caec77b-0a6d-4552-8cd8-239dcabc8e71 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:56:25 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b08172-fcf6-40b1-bfe3-feb963edfdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:25 devstack sudo[98688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 1073741824
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e1fd51-cb7f-4657-be3b-6e3afe371743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:25 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Volume volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e (174006d0-b1a4-4a20-bd55-bcfe1e9cda6e): created successfully
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e1fd51-cb7f-4657-be3b-6e3afe371743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Flow 'volume_create_manager' (364eb3ec-d2dc-49b4-bc27-1f0d17900d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f3686362-f601-401d-bc7c-a3b4a034bdad tempest-AttachVolumeNegativeTest-1661374885 None] Created volume successfully.
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "cinder-quobyte-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-quobyte-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[27852e78-3394-4b8c-abd4-6d409285c539]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:26 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:56:26 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:26 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 1073741824" returned: 0 in 0.837s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:26 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71
Jul 31 14:56:26 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:26 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.617s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:26 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b
Jul 31 14:56:26 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:26 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71" returned: 0 in 0.323s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba880e94-4a5b-4a4f-8313-6a08b3cacfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f86400e-971b-490d-8b89-83dc99722fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:26 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Volume volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 (9caec77b-0a6d-4552-8cd8-239dcabc8e71): created successfully
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f86400e-971b-490d-8b89-83dc99722fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Flow 'volume_create_manager' (5d865e41-6915-4f4a-9c87-d594f8bb030c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-079b3dbd-2dbb-44b8-9a8d-4ade2be8647c tempest-TestImageHashVerification-234709451 None] Created volume successfully.
Jul 31 14:56:27 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" returned: 0 in 0.294s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-quobyte-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b" released by "delete_volume" :: held 0.978s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Created reservations ['4fd7452b-4c08-4ab6-a525-efcfda50d3c3', '2409d66e-b77a-4335-8fdc-68daca3f483e', 'bc19eaf9-62b8-4d5e-8681-10122b62eb4e', '1bfe10ce-e071-47f3-a63b-24ec3bd26d98'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:27 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:56:27 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-33b2ab47-2993-4167-8688-c1d463fdf0f8 req-59f4eaf0-32d3-407e-8e34-b1acf572a14f tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-33b2ab47-2993-4167-8688-c1d463fdf0f8 req-59f4eaf0-32d3-407e-8e34-b1acf572a14f tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-33b2ab47-2993-4167-8688-c1d463fdf0f8 req-59f4eaf0-32d3-407e-8e34-b1acf572a14f tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-33b2ab47-2993-4167-8688-c1d463fdf0f8 req-59f4eaf0-32d3-407e-8e34-b1acf572a14f tempest-AttachVolumeNegativeTest-1661374885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18a77dd2-f125-449c-9683-08fae9da57bc', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:56:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-33b2ab47-2993-4167-8688-c1d463fdf0f8 req-59f4eaf0-32d3-407e-8e34-b1acf572a14f tempest-AttachVolumeNegativeTest-1661374885 None] attachment_update completed successfully.
Jul 31 14:56:27 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:56:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Deleted volume successfully.
Jul 31 14:56:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d7f0cc94-b46b-4284-bda3-37b7f924a2e8 tempest-VolumesActionsTest-1721591294 None] Lock "cinder-76d5f6b8-6c99-4444-a3f4-8190f2f9d89b-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Flow 'volume_create_manager' (d8c1fb9f-9dc6-44a1-9876-8abb35787c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ac5f69-5351-4ef6-a8a3-da9b69078249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ac5f69-5351-4ef6-a8a3-da9b69078249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1216888446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042eb275-83b1-4840-b496-d0e50f906aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f3504e9c80412a8a36f9caf978be12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:28Z,use_quota=True,user_id='44c965e7e06746b99bdd278cb9211175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c0b547-8029-4468-bdd0-7b20193f5056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c0b547-8029-4468-bdd0-7b20193f5056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5a72a1-b7db-4951-9c7a-bc7bab2a91f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5a72a1-b7db-4951-9c7a-bc7bab2a91f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042eb275-83b1-4840-b496-d0e50f906aff', 'volume_name': 'volume-042eb275-83b1-4840-b496-d0e50f906aff', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812a7af5-3b96-47a2-bc24-8596164d71f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812a7af5-3b96-47a2-bc24-8596164d71f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4847d568-6b9a-4f2c-8132-b5e3b0945fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Volume 042eb275-83b1-4840-b496-d0e50f906aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042eb275-83b1-4840-b496-d0e50f906aff', 'volume_size': 1}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1216888446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042eb275-83b1-4840-b496-d0e50f906aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f3504e9c80412a8a36f9caf978be12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:28Z,use_quota=True,user_id='44c965e7e06746b99bdd278cb9211175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Creating volume 042eb275-83b1-4840-b496-d0e50f906aff {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:56:28 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:28 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff 1073741824
Jul 31 14:56:28 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:28 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff 1073741824" returned: 0 in 0.555s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:28 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff
Jul 31 14:56:28 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:28 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.156s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4847d568-6b9a-4f2c-8132-b5e3b0945fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042eb275-83b1-4840-b496-d0e50f906aff', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734cd9df-5cb1-477b-a70c-5f2bb06cab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1f8916-1bd3-4a53-a93d-712dc14c64d2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Volume volume-042eb275-83b1-4840-b496-d0e50f906aff (042eb275-83b1-4840-b496-d0e50f906aff): created successfully
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734cd9df-5cb1-477b-a70c-5f2bb06cab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Flow 'volume_create_manager' (d8c1fb9f-9dc6-44a1-9876-8abb35787c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2f13d7d2-1551-4a4e-a7eb-5fa865c3b856 tempest-AttachVolumeTestJSON-506879225 None] Created volume successfully.
Jul 31 14:56:29 devstack sudo[98733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71
Jul 31 14:56:29 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:29 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71" returned: 0 in 0.434s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71bec71-f3b5-4b37-ae18-bcc256b69a30]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:29 devstack sudo[98739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71
Jul 31 14:56:29 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:29 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71" returned: 0 in 0.428s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 /opt/stack/data/cinder/conversion/9caec77b-0a6d-4552-8cd8-239dcabc8e71.temp_image.89aa0a8d-18d7-4e06-bcec-91fadf66b7e0t5jwdk91.img {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:29 devstack sudo[98745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 /opt/stack/data/cinder/conversion/9caec77b-0a6d-4552-8cd8-239dcabc8e71.temp_image.89aa0a8d-18d7-4e06-bcec-91fadf66b7e0t5jwdk91.img
Jul 31 14:56:29 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-c383d82f-69e1-499c-8c22-c976160e54c8 req-9bf830d4-8760-4253-813a-bac89c45b77d tempest-AttachVolumeNegativeTest-1661374885 None] Terminate volume connection completed successfully.
Jul 31 14:56:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-c383d82f-69e1-499c-8c22-c976160e54c8 req-9bf830d4-8760-4253-813a-bac89c45b77d tempest-AttachVolumeNegativeTest-1661374885 None] Deleting attachment 18a77dd2-f125-449c-9683-08fae9da57bc. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:56:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a083bc05-d006-4d3f-8230-5331a5e58f7f req-53c1950f-1070-4af5-a122-153f4f2aea9d tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:35 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 /opt/stack/data/cinder/conversion/9caec77b-0a6d-4552-8cd8-239dcabc8e71.temp_image.89aa0a8d-18d7-4e06-bcec-91fadf66b7e0t5jwdk91.img" returned: 0 in 5.816s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5e6b78-249e-4d0c-8108-efae216b5a21]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:56:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:35 devstack sudo[98799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71
Jul 31 14:56:35 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:36 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71" returned: 0 in 0.725s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:36 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/conversion/9caec77b-0a6d-4552-8cd8-239dcabc8e71.temp_image.89aa0a8d-18d7-4e06-bcec-91fadf66b7e0t5jwdk91.img {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:56:36 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Converted 1024.00 MB image at 175.90 MB/s
Jul 31 14:56:36 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] 89aa0a8d-18d7-4e06-bcec-91fadf66b7e0 was raw, no need to convert to raw {{(pid=88594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Flow 'volume_create_manager' (7da27e43-c11e-4b6f-8f99-a4f50228971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b46d21-4463-4dde-bbc4-7d44b4a39a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b46d21-4463-4dde-bbc4-7d44b4a39a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1721450973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d83b0205a44ed890019247c2121fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:39Z,use_quota=True,user_id='7030e4fc4fd845788e557a547a36bc5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c830cbc9-9d6f-45c3-9acd-194e18e1b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c830cbc9-9d6f-45c3-9acd-194e18e1b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9287c13d-8f8e-480e-be2e-7d89f86a425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9287c13d-8f8e-480e-be2e-7d89f86a425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6', 'volume_name': 'volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6', 'volume_size': 2}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f124e3-2526-4340-80e5-fefeb8a43189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f124e3-2526-4340-80e5-fefeb8a43189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38531e1d-eb19-458f-b854-f6d077da0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:56:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Volume 9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6', 'volume_size': 2}
Jul 31 14:56:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:49 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=3 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:56:49 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=18,cinder:SELECT=36,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:56:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:56:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:56:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:56:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:58 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:56:58 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:58 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.273s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.903s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Uploaded volume to glance image-id: 89aa0a8d-18d7-4e06-bcec-91fadf66b7e0. {{(pid=88594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a083bc05-d006-4d3f-8230-5331a5e58f7f req-53c1950f-1070-4af5-a122-153f4f2aea9d tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 27.185s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-a083bc05-d006-4d3f-8230-5331a5e58f7f req-53c1950f-1070-4af5-a122-153f4f2aea9d tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.722s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1721450973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d83b0205a44ed890019247c2121fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:56:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:56:39Z,use_quota=True,user_id='7030e4fc4fd845788e557a547a36bc5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Creating volume 9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:56:58 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 2147483648 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:58 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fb82e938-9aab-4152-8cf6-f20b1f710d47 tempest-TestImageHashVerification-234709451 None] Copy volume to image completed successfully.
Jul 31 14:56:58 devstack sudo[98947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 2147483648
Jul 31 14:56:58 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a083bc05-d006-4d3f-8230-5331a5e58f7f req-53c1950f-1070-4af5-a122-153f4f2aea9d tempest-AttachVolumeTestJSON-506879225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-042eb275-83b1-4840-b496-d0e50f906aff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c45cb980-9ff5-4be1-95b3-baf94f556606', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:56:59 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-a083bc05-d006-4d3f-8230-5331a5e58f7f req-53c1950f-1070-4af5-a122-153f4f2aea9d tempest-AttachVolumeTestJSON-506879225 None] attachment_update completed successfully.
Jul 31 14:56:59 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 2147483648" returned: 0 in 0.551s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:56:59 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6
Jul 31 14:56:59 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:56:59 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Jul 31 14:56:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6" returned: 0 in 0.397s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:56:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:56:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:56:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38531e1d-eb19-458f-b854-f6d077da0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6', 'volume_size': 2}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:56:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863adc55-e838-49ee-a02b-2ce8add59403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:00 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Volume volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 (9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6): created successfully
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863adc55-e838-49ee-a02b-2ce8add59403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Flow 'volume_create_manager' (7da27e43-c11e-4b6f-8f99-a4f50228971f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-25965b85-9173-4a19-992c-27d3f2fcb1ac tempest-VolumesCloneNegativeTest-1291640785 None] Created volume successfully.
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Acquiring lock "cinder-9caec77b-0a6d-4552-8cd8-239dcabc8e71-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Lock "cinder-9caec77b-0a6d-4552-8cd8-239dcabc8e71-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Acquiring lock "cinder-quobyte-9caec77b-0a6d-4552-8cd8-239dcabc8e71" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Lock "cinder-quobyte-9caec77b-0a6d-4552-8cd8-239dcabc8e71" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f6f8f-8969-48bf-8ce1-f68509da9bcb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:00 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71
Jul 31 14:57:00 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:00 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71" returned: 0 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:00 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71
Jul 31 14:57:00 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:00 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9caec77b-0a6d-4552-8cd8-239dcabc8e71" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Acquiring lock "cinder-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Lock "cinder-quobyte-9caec77b-0a6d-4552-8cd8-239dcabc8e71" released by "delete_volume" :: held 0.746s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Lock "cinder-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Acquiring lock "cinder-quobyte-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Lock "cinder-quobyte-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Created reservations ['c1c1e3ca-c763-4423-a59e-10d18dd069b7', '2e9dd878-d6f0-4086-9bd0-84d077871c95', '322d0605-4fd3-4c6a-b385-22516bc71fb1', '888c6f0d-b216-427d-8fbb-66975801f752'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f99cc-001c-4193-b381-b07c3bb835f7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:01 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:01 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:01 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6
Jul 31 14:57:01 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:01 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6" returned: 0 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:01 devstack sudo[98997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6
Jul 31 14:57:01 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:01 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.362s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:01 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Deleted volume successfully.
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33554491-7edc-46f8-b86c-d9524869cae2 tempest-TestImageHashVerification-234709451 None] Lock "cinder-9caec77b-0a6d-4552-8cd8-239dcabc8e71-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:01 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6" returned: 0 in 0.313s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Lock "cinder-quobyte-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6" released by "delete_volume" :: held 0.770s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Created reservations ['39a4f4a1-4dbe-40d3-9ff6-37952adda916', '7518ec09-03db-4104-af30-60906d180064', '8cf1950f-0b04-4389-97a6-f76638d482eb', '74ff0071-7fa6-46be-9ed4-6f7918b488ad'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:02 devstack sudo[99000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:02 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:02 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:02 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:02 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Deleted volume successfully.
Jul 31 14:57:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fd72c21b-ae63-49b7-a1ec-ec4bc47088aa tempest-VolumesCloneNegativeTest-1291640785 None] Lock "cinder-9c4b06c4-cb5c-4c65-b5c4-800811e4cbf6-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:02 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-f1e6253b-68f6-4781-a5f5-d74293b6e08b req-8fa53ab7-3446-47f1-99df-a9d104636166 tempest-AttachVolumeTestJSON-506879225 None] Terminate volume connection completed successfully.
Jul 31 14:57:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-f1e6253b-68f6-4781-a5f5-d74293b6e08b req-8fa53ab7-3446-47f1-99df-a9d104636166 tempest-AttachVolumeTestJSON-506879225 None] Deleting attachment 61bdf447-37d4-4cbc-95a6-32ba9baaea99. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:57:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-1cea3803-26c8-45e0-b06c-1f2ee68b7f37 req-cadf89c3-d103-40a5-a432-935a578a622d tempest-AttachVolumeTestJSON-506879225 None] Terminate volume connection completed successfully.
Jul 31 14:57:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-1cea3803-26c8-45e0-b06c-1f2ee68b7f37 req-cadf89c3-d103-40a5-a432-935a578a622d tempest-AttachVolumeTestJSON-506879225 None] Deleting attachment c45cb980-9ff5-4be1-95b3-baf94f556606. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Flow 'volume_create_manager' (b2f1808c-2669-468d-9b64-563153f58fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6516fd11-aede-4af2-9080-6105b3b951a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6516fd11-aede-4af2-9080-6105b3b951a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124829943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf491cb-f86b-48e9-85db-cc656a98af2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c730d587cc784c07975e3b2aea384284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:11Z,use_quota=True,user_id='cdf4df88abe54391b71548c750a96149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02bd803-6213-447b-baf5-9c68518bc815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02bd803-6213-447b-baf5-9c68518bc815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77f4ad4-8284-4bfa-a1e3-dc6d63785eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77f4ad4-8284-4bfa-a1e3-dc6d63785eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf491cb-f86b-48e9-85db-cc656a98af2e', 'volume_name': 'volume-2cf491cb-f86b-48e9-85db-cc656a98af2e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2108fa17-4a9d-4dfa-a2aa-132f3ee041c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2108fa17-4a9d-4dfa-a2aa-132f3ee041c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c092bfb-ae1f-4762-86e9-a05fd406a3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Volume 2cf491cb-f86b-48e9-85db-cc656a98af2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf491cb-f86b-48e9-85db-cc656a98af2e', 'volume_size': 1}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124829943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf491cb-f86b-48e9-85db-cc656a98af2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c730d587cc784c07975e3b2aea384284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:11Z,use_quota=True,user_id='cdf4df88abe54391b71548c750a96149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Creating volume 2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:10 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:10 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e 1073741824
Jul 31 14:57:10 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "cinder-042eb275-83b1-4840-b496-d0e50f906aff-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-042eb275-83b1-4840-b496-d0e50f906aff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:11 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e 1073741824" returned: 0 in 0.742s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "cinder-quobyte-042eb275-83b1-4840-b496-d0e50f906aff" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:11 devstack sudo[99104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e
Jul 31 14:57:11 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Flow 'volume_create_manager' (31e8898a-1bd7-4034-8c2a-26f2d0079e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1f7663-1c08-46e1-9af8-64d1365f2ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-quobyte-042eb275-83b1-4840-b496-d0e50f906aff" acquired by "delete_volume" :: waited 0.099s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1f7663-1c08-46e1-9af8-64d1365f2ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437813960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c8bbef-8c7a-4903-9c46-de3d2a03c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94e77a2947042f29eae53b669c15b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:11Z,use_quota=True,user_id='9b51a90105b94fc4a3dfa0ffe6710cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ba9119-c961-410f-8865-727640c717a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ba9119-c961-410f-8865-727640c717a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86baefb-c37a-490c-a188-e10c6c69ec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86baefb-c37a-490c-a188-e10c6c69ec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c8bbef-8c7a-4903-9c46-de3d2a03c973', 'volume_name': 'volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55999751-2d6d-4eee-a49e-5222c0591ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55999751-2d6d-4eee-a49e-5222c0591ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e9bcfe-f836-4a45-ad48-c27565bd5f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Volume d1c8bbef-8c7a-4903-9c46-de3d2a03c973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973', 'volume_size': 1}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf5028-ca86-491e-b543-d57357cbcfe6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:11 devstack sudo[99106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff
Jul 31 14:57:11 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:11 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e" returned: 0 in 0.309s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437813960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c8bbef-8c7a-4903-9c46-de3d2a03c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94e77a2947042f29eae53b669c15b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:11Z,use_quota=True,user_id='9b51a90105b94fc4a3dfa0ffe6710cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Creating volume d1c8bbef-8c7a-4903-9c46-de3d2a03c973 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:11 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c092bfb-ae1f-4762-86e9-a05fd406a3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf491cb-f86b-48e9-85db-cc656a98af2e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:11 devstack sudo[99109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973 1073741824
Jul 31 14:57:11 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c120c4c-4860-4d72-b4ab-b9949350e799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Volume volume-2cf491cb-f86b-48e9-85db-cc656a98af2e (2cf491cb-f86b-48e9-85db-cc656a98af2e): created successfully
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c120c4c-4860-4d72-b4ab-b9949350e799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Flow 'volume_create_manager' (b2f1808c-2669-468d-9b64-563153f58fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9171e24f-729b-4046-80fc-9e51e40113ee tempest-VolumesSnapshotListTestJSON-1200832113 None] Created volume successfully.
Jul 31 14:57:12 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff" returned: 0 in 0.415s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:12 devstack sudo[99115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff
Jul 31 14:57:12 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:12 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973 1073741824" returned: 0 in 0.515s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:12 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-042eb275-83b1-4840-b496-d0e50f906aff" returned: 0 in 0.315s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-quobyte-042eb275-83b1-4840-b496-d0e50f906aff" released by "delete_volume" :: held 0.814s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:12 devstack sudo[99122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973
Jul 31 14:57:12 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Created reservations ['2215fd15-8ca2-404e-ab32-905224f02af9', 'd4414d8d-b5e9-48c1-824b-52b3c0381a7c', 'fa306b16-e2b6-4ccc-b759-b7d2a8cdd4f9', '4c2e546d-d92a-4188-8464-fcb53d660f0d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:12 devstack sudo[99124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:12 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:12 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973" returned: 0 in 0.347s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e9bcfe-f836-4a45-ad48-c27565bd5f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900540f1-3d8e-4f86-ba49-bc6c31883c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:12 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Volume volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973 (d1c8bbef-8c7a-4903-9c46-de3d2a03c973): created successfully
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900540f1-3d8e-4f86-ba49-bc6c31883c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Flow 'volume_create_manager' (31e8898a-1bd7-4034-8c2a-26f2d0079e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-66efbd8f-21bc-4d20-84ff-6eff2a51680c tempest-AttachVolumeNegativeTest-1661374885 None] Created volume successfully.
Jul 31 14:57:12 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.337s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Deleted volume successfully.
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Creating offline snapshot 8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 of volume 2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-11c7c9c7-411b-4afb-b582-3aa24a01ea2a tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-042eb275-83b1-4840-b496-d0e50f906aff-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fedb1dc-ea58-461c-a709-297f7f7295bd]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:13 devstack sudo[99128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e
Jul 31 14:57:13 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:13 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e" returned: 0 in 0.376s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:13 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 1G
Jul 31 14:57:13 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "cinder-0aea72f7-bca1-4cd7-993b-5015cec4db13-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-0aea72f7-bca1-4cd7-993b-5015cec4db13-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "cinder-quobyte-0aea72f7-bca1-4cd7-993b-5015cec4db13" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-quobyte-0aea72f7-bca1-4cd7-993b-5015cec4db13" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[31683bc6-0188-4281-a7f9-4ba1ea0718e6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:13 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 1G" returned: 0 in 0.549s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:13 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1
Jul 31 14:57:13 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:14 devstack sudo[99141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13
Jul 31 14:57:14 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:14 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13" returned: 0 in 0.486s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:14 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" returned: 0 in 0.502s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:14 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 is being set with open permissions: ugo+rw
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:14 devstack sudo[99158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13
Jul 31 14:57:14 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:14 devstack sudo[99161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1
Jul 31 14:57:14 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-16794adc-da03-4c25-b13c-a1017c9d6671 req-8bb5174c-bc8a-430b-b5f2-f8039829c83f tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:14 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0aea72f7-bca1-4cd7-993b-5015cec4db13" returned: 0 in 0.307s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:14 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-quobyte-0aea72f7-bca1-4cd7-993b-5015cec4db13" released by "delete_volume" :: held 0.855s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:14 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.info
Jul 31 14:57:14 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Created reservations ['08f644a8-0020-4cc6-9167-618732a2a041', '313ce4df-88d5-45b1-9219-80af22740778', '21dce2a6-ff15-4276-9d58-2674aa3b44d8', '6ff2a36c-eb21-4156-9337-6a77f834b592'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:14 devstack sudo[99167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:14 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:14 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (358d074d-235e-412c-8c1c-d73c6c8c615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47557f3f-5d75-4d6a-928d-e3c7907d5c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47557f3f-5d75-4d6a-928d-e3c7907d5c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548236403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d3f256-df3f-49bf-960d-32e6bda424b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:15Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9cab93-abe7-4b5d-8f51-8f0347a46705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:15 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9cab93-abe7-4b5d-8f51-8f0347a46705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230ed30c-afb2-4721-87ba-f89aff69bf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230ed30c-afb2-4721-87ba-f89aff69bf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d3f256-df3f-49bf-960d-32e6bda424b8', 'volume_name': 'volume-02d3f256-df3f-49bf-960d-32e6bda424b8', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fc9fe4-4462-4e13-9200-08d7e1d08eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fc9fe4-4462-4e13-9200-08d7e1d08eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4b65ae-bd54-42cb-bf9a-fb28cda4f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:15 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume 02d3f256-df3f-49bf-960d-32e6bda424b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d3f256-df3f-49bf-960d-32e6bda424b8', 'volume_size': 1}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "cinder-ffe415c7-b4c9-4ad0-9c24-447dd693961e-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.info" returned: 0 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:15 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.info is being set with open permissions: ugo+rw
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-ffe415c7-b4c9-4ad0-9c24-447dd693961e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:15 devstack sudo[99170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.info
Jul 31 14:57:15 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "cinder-quobyte-ffe415c7-b4c9-4ad0-9c24-447dd693961e" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:15 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.306s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-quobyte-ffe415c7-b4c9-4ad0-9c24-447dd693961e" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:15 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Deleted volume successfully.
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d08a60-de85-4930-af0a-b93e05fd9c93]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249cef74-f779-4d70-a6b1-0e1dcfc5e19b tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-0aea72f7-bca1-4cd7-993b-5015cec4db13-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:15 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e
Jul 31 14:57:15 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:15 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.info" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-16794adc-da03-4c25-b13c-a1017c9d6671 req-8bb5174c-bc8a-430b-b5f2-f8039829c83f tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.841s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-16794adc-da03-4c25-b13c-a1017c9d6671 req-8bb5174c-bc8a-430b-b5f2-f8039829c83f tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548236403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d3f256-df3f-49bf-960d-32e6bda424b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:15Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Creating volume 02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:15 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:15 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 1073741824
Jul 31 14:57:15 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:15 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-90e0c7c7-2227-4900-8213-c3c3c0e2d059 tempest-VolumesSnapshotListTestJSON-1200832113 None] Create snapshot completed successfully
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-16794adc-da03-4c25-b13c-a1017c9d6671 req-8bb5174c-bc8a-430b-b5f2-f8039829c83f tempest-AttachVolumeNegativeTest-1661374885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc7b46b5-a440-4e2b-adfb-c33356d56209', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:57:15 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-16794adc-da03-4c25-b13c-a1017c9d6671 req-8bb5174c-bc8a-430b-b5f2-f8039829c83f tempest-AttachVolumeNegativeTest-1661374885 None] attachment_update completed successfully.
Jul 31 14:57:15 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e" returned: 0 in 0.427s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:15 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e
Jul 31 14:57:15 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:15 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 1073741824" returned: 0 in 0.489s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:15 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ffe415c7-b4c9-4ad0-9c24-447dd693961e" returned: 0 in 0.295s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-quobyte-ffe415c7-b4c9-4ad0-9c24-447dd693961e" released by "delete_volume" :: held 0.774s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:16 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8
Jul 31 14:57:16 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Created reservations ['917f5d1e-3669-4537-b850-947acf7bb292', '48eeadb4-6ac2-4bd8-8264-f64fe9c8b721', '3b72c1b3-0bd4-4f33-af34-d19ad0c9d1bc', '790203bb-345e-4779-929c-ce9dd7b7db55'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:16 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:16 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:16 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8" returned: 0 in 0.336s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4b65ae-bd54-42cb-bf9a-fb28cda4f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d3f256-df3f-49bf-960d-32e6bda424b8', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30b1193-8a0f-4c4b-becd-5f63d3400ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:16 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume volume-02d3f256-df3f-49bf-960d-32e6bda424b8 (02d3f256-df3f-49bf-960d-32e6bda424b8): created successfully
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30b1193-8a0f-4c4b-becd-5f63d3400ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (358d074d-235e-412c-8c1c-d73c6c8c615c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5de42bec-e10f-4b81-bd35-d47874c7034b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created volume successfully.
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:16 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.396s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Deleted volume successfully.
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Creating offline snapshot e3a794dc-9fc6-49c3-ae27-7a93ef4a954d of volume 2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d7f3a-0c6c-42b0-a17a-3b35d1372fd5]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-726b5b4d-f02e-4d73-88cf-bb2108ffa926 tempest-AttachVolumeTestJSON-506879225 None] Lock "cinder-ffe415c7-b4c9-4ad0-9c24-447dd693961e-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:16 devstack sudo[99580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1
Jul 31 14:57:16 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:16 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" returned: 0 in 0.381s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf491cb-f86b-48e9-85db-cc656a98af2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:17 devstack sudo[99585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d 1G
Jul 31 14:57:17 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:17 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d 1G" returned: 0 in 0.540s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:17 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d
Jul 31 14:57:17 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:17 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:17 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d is being set with open permissions: ugo+rw
Jul 31 14:57:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:17 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d
Jul 31 14:57:17 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:18 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.731s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.940s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Creating offline snapshot 893029f1-c6e8-473c-81bf-97687026a5b3 of volume 02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:57:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e835e5c3-e373-4a43-af20-8579a9afad50 tempest-VolumesSnapshotListTestJSON-1200832113 None] Create snapshot completed successfully
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cbbab-0698-42d4-b67c-4a9245c97b40]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:18 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8
Jul 31 14:57:18 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-a3b02d54-8de7-4e25-807a-140318184fc3 req-01ca4585-cc5e-41bd-8241-5a266d29f3d8 tempest-AttachVolumeNegativeTest-1661374885 None] Terminate volume connection completed successfully.
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-a3b02d54-8de7-4e25-807a-140318184fc3 req-01ca4585-cc5e-41bd-8241-5a266d29f3d8 tempest-AttachVolumeNegativeTest-1661374885 None] Deleting attachment bc7b46b5-a440-4e2b-adfb-c33356d56209. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:57:18 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8" returned: 0 in 0.511s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:18 devstack sudo[99634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 1G
Jul 31 14:57:18 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:19 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 1G" returned: 0 in 0.505s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d3f256-df3f-49bf-960d-32e6bda424b8 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:19 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d3f256-df3f-49bf-960d-32e6bda424b8 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3
Jul 31 14:57:19 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:19 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d3f256-df3f-49bf-960d-32e6bda424b8 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3" returned: 0 in 0.447s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:19 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 is being set with open permissions: ugo+rw
Jul 31 14:57:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:19 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3
Jul 31 14:57:19 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:20 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3" returned: 0 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:20 devstack sudo[99670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.info
Jul 31 14:57:20 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:20 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.info" returned: 0 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:20 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.info is being set with open permissions: ugo+rw
Jul 31 14:57:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:20 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.info
Jul 31 14:57:20 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:20 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.info" returned: 0 in 0.335s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.717s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.106s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Creating offline snapshot 8fb32733-a7bc-41b2-b0a6-ff513172c10d of volume 2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:57:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-14358106-cc4c-48a7-8394-0d4ac7e8ad9d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Create snapshot completed successfully
Jul 31 14:57:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d6b490-a8ec-4f32-8c8a-7c2eddac0149]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:21 devstack sudo[99678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d
Jul 31 14:57:21 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:21 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" returned: 0 in 0.477s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf491cb-f86b-48e9-85db-cc656a98af2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:21 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d 1G
Jul 31 14:57:21 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (2c4251d8-efc9-4dcd-9e80-40b51013295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea9c613-1736-45fe-92e0-ef6f739eb8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea9c613-1736-45fe-92e0-ef6f739eb8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417066522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4678dcb1-9c8c-4486-be3c-86e230f8dd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:22Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95d5020-6924-4a25-8ff6-af3be3d78d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95d5020-6924-4a25-8ff6-af3be3d78d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff2962f-9c9d-4fcf-b6bf-9725699f269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff2962f-9c9d-4fcf-b6bf-9725699f269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4678dcb1-9c8c-4486-be3c-86e230f8dd77', 'volume_name': 'volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a213435d-00cf-480e-a709-67f6f1a42d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a213435d-00cf-480e-a709-67f6f1a42d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340e9281-7d48-4dfe-b4a3-e36abab0ce18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume 4678dcb1-9c8c-4486-be3c-86e230f8dd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77', 'volume_size': 1}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d 1G" returned: 0 in 0.735s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:22 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d
Jul 31 14:57:22 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:22 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d" returned: 0 in 0.404s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:22 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d is being set with open permissions: ugo+rw
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:22 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d
Jul 31 14:57:22 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (f95f7a02-9ff8-4bb4-b4bc-2b0d690ace40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211a48eb-90b3-4d77-90c0-4018e48047ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211a48eb-90b3-4d77-90c0-4018e48047ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828496734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb4c8e7-ed29-4683-a886-d1cdf4f8da37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:23Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b1aa3b-cdb9-4075-b761-f7d9fca83190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b1aa3b-cdb9-4075-b761-f7d9fca83190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb678b4-ff8d-4901-a95b-1fa84a9f614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb678b4-ff8d-4901-a95b-1fa84a9f614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb4c8e7-ed29-4683-a886-d1cdf4f8da37', 'volume_name': 'volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1252c9a3-7d3f-47a7-890d-5685fdff8dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1252c9a3-7d3f-47a7-890d-5685fdff8dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cccc71-7eaa-4e49-8ec8-e27361c740b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:22 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume deb4c8e7-ed29-4683-a886-d1cdf4f8da37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37', 'volume_size': 1}
Jul 31 14:57:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:23 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417066522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4678dcb1-9c8c-4486-be3c-86e230f8dd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:22Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Creating volume 4678dcb1-9c8c-4486-be3c-86e230f8dd77 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:23 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:23 devstack sudo[99702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77 1073741824
Jul 31 14:57:23 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:23 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-03b94672-292b-4bc1-93ed-c10a5b13092c tempest-VolumesSnapshotListTestJSON-1200832113 None] Create snapshot completed successfully
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (20e676a3-0e92-4715-970f-32548f134052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0afd14-6f7f-4085-ac86-004e97769f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0afd14-6f7f-4085-ac86-004e97769f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675146713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be693a51-3b99-41a0-a560-acb54daaa0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:23Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3136c89-9840-4a9b-ae61-37f2db514c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3136c89-9840-4a9b-ae61-37f2db514c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba594d2-3800-4981-8639-d1152753979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba594d2-3800-4981-8639-d1152753979a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be693a51-3b99-41a0-a560-acb54daaa0aa', 'volume_name': 'volume-be693a51-3b99-41a0-a560-acb54daaa0aa', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386662a6-dc1f-438a-ae1b-2de154db416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386662a6-dc1f-438a-ae1b-2de154db416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856f7834-9a77-4433-82f7-03c3879384bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume be693a51-3b99-41a0-a560-acb54daaa0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be693a51-3b99-41a0-a560-acb54daaa0aa', 'volume_size': 1}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:23 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (b06f9cd7-5385-4007-ad29-1e6e5df0f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b5333-c561-4707-aeb8-946ae18f5f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77 1073741824" returned: 0 in 0.665s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b5333-c561-4707-aeb8-946ae18f5f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037406859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f091409f-5413-48d5-8c29-92d8e6081600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:24Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a98b58-4f54-4565-83bc-d198624bc34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a98b58-4f54-4565-83bc-d198624bc34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54884f31-8a54-486c-a0b7-3a9262cfd5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54884f31-8a54-486c-a0b7-3a9262cfd5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f091409f-5413-48d5-8c29-92d8e6081600', 'volume_name': 'volume-f091409f-5413-48d5-8c29-92d8e6081600', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662731b6-1ed8-4447-a437-7f0cd098b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662731b6-1ed8-4447-a437-7f0cd098b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e47648c-40aa-4836-8633-0815218c216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume f091409f-5413-48d5-8c29-92d8e6081600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f091409f-5413-48d5-8c29-92d8e6081600', 'volume_size': 1}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:23 devstack sudo[99708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77
Jul 31 14:57:23 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:24 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (4446afd5-2c1b-4a7f-9d33-89313d19b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497ed973-3c49-4c7a-a2d9-151148e6ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77" returned: 0 in 0.533s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828496734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb4c8e7-ed29-4683-a886-d1cdf4f8da37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:23Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Creating volume deb4c8e7-ed29-4683-a886-d1cdf4f8da37 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:24 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497ed973-3c49-4c7a-a2d9-151148e6ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1423715187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0257edde-3ded-4cf4-ad17-ed6578b626e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:24Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf112b2e-d890-437f-afca-6ded9e4d82bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf112b2e-d890-437f-afca-6ded9e4d82bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b1380d-9314-4661-a3a1-1d63fdbca565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:24 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37 1073741824
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b1380d-9314-4661-a3a1-1d63fdbca565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0257edde-3ded-4cf4-ad17-ed6578b626e1', 'volume_name': 'volume-0257edde-3ded-4cf4-ad17-ed6578b626e1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:24 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359594c0-0b62-4853-8cb7-fc15efbec52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359594c0-0b62-4853-8cb7-fc15efbec52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b66f17-f8c9-41a6-b9e2-c9dbcd592352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:24 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume 0257edde-3ded-4cf4-ad17-ed6578b626e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0257edde-3ded-4cf4-ad17-ed6578b626e1', 'volume_size': 1}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340e9281-7d48-4dfe-b4a3-e36abab0ce18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98957ee5-8dd6-45f3-93d3-fdc761c80f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:24 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77 (4678dcb1-9c8c-4486-be3c-86e230f8dd77): created successfully
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98957ee5-8dd6-45f3-93d3-fdc761c80f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (2c4251d8-efc9-4dcd-9e80-40b51013295f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:24 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-38abbc31-1aee-4065-a251-3bacfadc99d0 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created volume successfully.
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "cinder-d1c8bbef-8c7a-4903-9c46-de3d2a03c973-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-d1c8bbef-8c7a-4903-9c46-de3d2a03c973-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "cinder-quobyte-d1c8bbef-8c7a-4903-9c46-de3d2a03c973" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-quobyte-d1c8bbef-8c7a-4903-9c46-de3d2a03c973" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-01fd73c2-5ba5-4e3d-bc06-288901d7deb3 tempest-BackendsCapabilitiesAdminTestsJSON-2015078469 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6902122497559, 'free_capacity_gb': 1775.6902122497559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01b67f9-f55c-4ba4-9a24-8f38eae8336b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-64fca29a-5f84-417d-b4b4-86571f248a3e tempest-BackendsCapabilitiesAdminTestsJSON-2015078469 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6902122497559, 'free_capacity_gb': 1775.6902122497559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 31 14:57:25 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37 1073741824" returned: 0 in 0.750s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:25 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973
Jul 31 14:57:25 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:25 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37
Jul 31 14:57:25 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-8fb32733-a7bc-41b2-b0a6-ff513172c10d-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-8fb32733-a7bc-41b2-b0a6-ff513172c10d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-quobyte-8fb32733-a7bc-41b2-b0a6-ff513172c10d" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-8fb32733-a7bc-41b2-b0a6-ff513172c10d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Deleting offline snapshot 8fb32733-a7bc-41b2-b0a6-ff513172c10d of volume 2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] snapshot_file for this snap is: volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:57:25 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973" returned: 0 in 0.489s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:25 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f1e8ca-89a3-40ce-8a17-756ebbfbbafa]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:25 devstack sudo[99732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973
Jul 31 14:57:25 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37" returned: 0 in 0.385s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.258s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675146713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be693a51-3b99-41a0-a560-acb54daaa0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:23Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Creating volume be693a51-3b99-41a0-a560-acb54daaa0aa {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:25 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cccc71-7eaa-4e49-8ec8-e27361c740b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:25 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa 1073741824
Jul 31 14:57:25 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659c8a37-50a0-4725-94cd-c0f3b3aa440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37 (deb4c8e7-ed29-4683-a886-d1cdf4f8da37): created successfully
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659c8a37-50a0-4725-94cd-c0f3b3aa440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (f95f7a02-9ff8-4bb4-b4bc-2b0d690ace40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fb19add4-29e6-4f65-bf77-657e14a19cd8 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created volume successfully.
Jul 31 14:57:25 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d
Jul 31 14:57:25 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:25 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1c8bbef-8c7a-4903-9c46-de3d2a03c973" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-quobyte-d1c8bbef-8c7a-4903-9c46-de3d2a03c973" released by "delete_volume" :: held 0.858s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Created reservations ['2cabffae-79c3-4ab6-bf8a-3ef6dc56989e', 'e818a929-a8b9-4f02-b45b-17b4ad9774d1', 'b292bd1a-5b33-4f4e-9b4b-87abaaf90c49', 'c75152fa-c23c-4d5f-9c38-545e004c1469'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:26 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d" returned: 0 in 0.487s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf491cb-f86b-48e9-85db-cc656a98af2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:26 devstack sudo[99746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:26 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc9ed7-9706-4039-a3e8-03699b63ecff]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:26 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d
Jul 31 14:57:26 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "cinder-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:26 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa 1073741824" returned: 0 in 0.680s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "cinder-quobyte-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:26 devstack sudo[99750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa
Jul 31 14:57:26 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-quobyte-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e" acquired by "delete_volume" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8dd27f-09b4-4d5b-af06-ad1747f968c6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:26 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.454s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:26 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Deleted volume successfully.
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e18d56b9-135b-4fc2-8bb6-8e5ebab4e8d8 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-d1c8bbef-8c7a-4903-9c46-de3d2a03c973-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:26 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" returned: 0 in 0.510s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf491cb-f86b-48e9-85db-cc656a98af2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:26 devstack sudo[99758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d
Jul 31 14:57:26 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:26 devstack sudo[99753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e
Jul 31 14:57:26 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:26 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa" returned: 0 in 0.415s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037406859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f091409f-5413-48d5-8c29-92d8e6081600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:24Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Creating volume f091409f-5413-48d5-8c29-92d8e6081600 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:26 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856f7834-9a77-4433-82f7-03c3879384bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be693a51-3b99-41a0-a560-acb54daaa0aa', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:26 devstack sudo[99762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600 1073741824
Jul 31 14:57:26 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5949e9-32cf-45c3-b832-20a28567f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:26 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume volume-be693a51-3b99-41a0-a560-acb54daaa0aa (be693a51-3b99-41a0-a560-acb54daaa0aa): created successfully
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5949e9-32cf-45c3-b832-20a28567f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:26 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (20e676a3-0e92-4715-970f-32548f134052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:26 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-92bf0186-0591-48b6-b7da-a6473a8386e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created volume successfully.
Jul 31 14:57:27 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e" returned: 0 in 0.518s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:27 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e
Jul 31 14:57:27 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:27 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d" returned: 0 in 0.551s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:27 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d
Jul 31 14:57:27 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:27 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-quobyte-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e" released by "delete_volume" :: held 0.980s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:27 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600 1073741824" returned: 0 in 0.652s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Created reservations ['542d3d98-19bc-40eb-8c5c-408f72b23356', 'a66ec2bf-d2b2-4cff-8d1d-ac2e1be480c3', 'e8b57669-3ed9-4c15-9882-b321063bec2f', '3f35d3f5-79f0-4534-81c3-98d0921fd735'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:27 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8fb32733-a7bc-41b2-b0a6-ff513172c10d" returned: 0 in 0.360s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:27 devstack sudo[99780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600
Jul 31 14:57:27 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-8fb32733-a7bc-41b2-b0a6-ff513172c10d" released by "_delete_snapshot" :: held 2.084s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" released by "delete_snapshot" :: held 2.127s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:27 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:27 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Created reservations ['faab2519-d051-4742-a4f5-1f1bd8ff3306', '64b0fda3-78a2-4264-a290-ff8a1f5b917c', 'bed27b9f-e9c9-4574-b0d4-f570338b756c', 'e18a9113-fa25-4d80-b2a4-3edc7d89cf61'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Delete snapshot completed successfully.
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-70bc134b-6082-4ea6-ba50-e494b0697b4d tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-8fb32733-a7bc-41b2-b0a6-ff513172c10d-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:27 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600" returned: 0 in 0.323s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.399s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1423715187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0257edde-3ded-4cf4-ad17-ed6578b626e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ce439899ab42e183551a4c8fba35dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:24Z,use_quota=True,user_id='5765518cc7474df388640824180071a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Creating volume 0257edde-3ded-4cf4-ad17-ed6578b626e1 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:27 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e47648c-40aa-4836-8633-0815218c216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f091409f-5413-48d5-8c29-92d8e6081600', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:27 devstack sudo[99785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1 1073741824
Jul 31 14:57:27 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148b88b3-8ea9-41a5-a509-eb9d1f5883c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume volume-f091409f-5413-48d5-8c29-92d8e6081600 (f091409f-5413-48d5-8c29-92d8e6081600): created successfully
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148b88b3-8ea9-41a5-a509-eb9d1f5883c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (b06f9cd7-5385-4007-ad29-1e6e5df0f161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-627abdaf-874a-4460-ac7f-7a5c91c4b4e1 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created volume successfully.
Jul 31 14:57:28 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.333s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Deleted volume successfully.
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d354045d-8cca-4105-bc49-eab0c564f6b2 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-174006d0-b1a4-4a20-bd55-bcfe1e9cda6e-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:28 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1 1073741824" returned: 0 in 0.491s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:28 devstack sudo[99792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1
Jul 31 14:57:28 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:28 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1" returned: 0 in 0.315s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b66f17-f8c9-41a6-b9e2-c9dbcd592352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0257edde-3ded-4cf4-ad17-ed6578b626e1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4644acb3-d09e-43d2-9e50-9053e960c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Volume volume-0257edde-3ded-4cf4-ad17-ed6578b626e1 (0257edde-3ded-4cf4-ad17-ed6578b626e1): created successfully
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4644acb3-d09e-43d2-9e50-9053e960c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Flow 'volume_create_manager' (4446afd5-2c1b-4a7f-9d33-89313d19b899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b2fb9876-4ce7-4815-8931-7b84f57e996a tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created volume successfully.
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "cinder-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-e3a794dc-9fc6-49c3-ae27-7a93ef4a954d-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-e3a794dc-9fc6-49c3-ae27-7a93ef4a954d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-quobyte-e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "cinder-quobyte-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Deleting offline snapshot e3a794dc-9fc6-49c3-ae27-7a93ef4a954d of volume 2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] snapshot_file for this snap is: volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-quobyte-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d" acquired by "delete_volume" :: waited 0.083s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cc07e5-58ed-4f85-96a5-fe1f276c352a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f6cd35-ac60-411c-a68c-ce2f2bbda383]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-0257edde-3ded-4cf4-ad17-ed6578b626e1-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-0257edde-3ded-4cf4-ad17-ed6578b626e1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-0257edde-3ded-4cf4-ad17-ed6578b626e1" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:29 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d
Jul 31 14:57:29 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-0257edde-3ded-4cf4-ad17-ed6578b626e1" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:29 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d
Jul 31 14:57:29 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d57f956-86a4-44e1-8035-c476713ec6e7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:29 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1
Jul 31 14:57:29 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:29 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:29 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d" returned: 0 in 0.494s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" returned: 0 in 0.524s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf491cb-f86b-48e9-85db-cc656a98af2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:29 devstack sudo[99808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d
Jul 31 14:57:29 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b42b97d-e058-491d-9b56-953c7cfe0f46]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:29 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1" returned: 0 in 0.424s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:29 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1
Jul 31 14:57:29 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:29 devstack sudo[99814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1
Jul 31 14:57:29 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:30 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-quobyte-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d" released by "delete_volume" :: held 0.891s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Created reservations ['d4390c9e-20bf-4769-9fa5-de799ba670c3', '6d615d31-0d39-4a4a-a05a-9758049fe0e7', '8750528a-4852-4413-bdfc-9a54dd86b698', 'f6d6379f-bd78-4c81-bdd6-3be8ccad11a0'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:30 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" returned: 0 in 0.477s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf491cb-f86b-48e9-85db-cc656a98af2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:30 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0257edde-3ded-4cf4-ad17-ed6578b626e1" returned: 0 in 0.413s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:30 devstack sudo[99823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d
Jul 31 14:57:30 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-0257edde-3ded-4cf4-ad17-ed6578b626e1" released by "delete_volume" :: held 0.920s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:30 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:30 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created reservations ['8588a2e7-b2f9-4247-855f-405f821e8481', 'dc951e1a-69ea-46cf-a7ca-b0908d820bca', '49185567-c43d-46cb-9177-cb950d7ee00c', '3dff3a51-404a-41a9-9413-edeb62acab01'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:30 devstack sudo[99829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:30 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:30 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.339s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Deleted volume successfully.
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0d592913-9695-42ae-b1ac-a35b27861635 tempest-AttachVolumeNegativeTest-1661374885 None] Lock "cinder-b5b3d3da-8e76-48f2-9dc6-2d503f25fb2d-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:30 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" returned: 0 in 0.480s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:30 devstack sudo[99833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d
Jul 31 14:57:30 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:30 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Deleted volume successfully.
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c1d48eb7-c322-4973-a686-1629d7cae707 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-0257edde-3ded-4cf4-ad17-ed6578b626e1-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:30 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-e3a794dc-9fc6-49c3-ae27-7a93ef4a954d" released by "_delete_snapshot" :: held 1.887s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" released by "delete_snapshot" :: held 1.935s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Created reservations ['e10c24a1-2caa-4768-9b4c-25ef4a796bcc', '6844cdfb-6e0e-4c25-b291-84dddcb776b5', '8c27628c-e74d-44f1-9fc8-eb195597f6c1', 'c020c686-d718-439f-9aba-eef486e42554'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Delete snapshot completed successfully.
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5e138017-c468-47ce-9e2e-e0357c37814c tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-e3a794dc-9fc6-49c3-ae27-7a93ef4a954d-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-quobyte-8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Deleting offline snapshot 8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 of volume 2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] snapshot_file for this snap is: volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d58e8c-1db9-4f98-b82d-3e8b6e69893f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:31 devstack sudo[99837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1
Jul 31 14:57:31 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-f091409f-5413-48d5-8c29-92d8e6081600-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-f091409f-5413-48d5-8c29-92d8e6081600-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-f091409f-5413-48d5-8c29-92d8e6081600" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-f091409f-5413-48d5-8c29-92d8e6081600" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe28d51e-055b-4d26-ac4c-5a8e3357bf55]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:31 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" returned: 0 in 0.498s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf491cb-f86b-48e9-85db-cc656a98af2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfabc10-8cce-423b-bf48-18552a74b2b1]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:31 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600
Jul 31 14:57:31 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:31 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e
Jul 31 14:57:31 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:32 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600" returned: 0 in 0.406s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:32 devstack sudo[99850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600
Jul 31 14:57:32 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:32 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e" returned: 0 in 0.425s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:32 devstack sudo[99855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1
Jul 31 14:57:32 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:32 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f091409f-5413-48d5-8c29-92d8e6081600" returned: 0 in 0.332s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-f091409f-5413-48d5-8c29-92d8e6081600" released by "delete_volume" :: held 0.806s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created reservations ['f4e57d83-b6f3-4c8d-bf45-34a604c51d29', '874fca86-2db7-413c-bef0-afa328cf9011', 'c659f195-55c0-4b9f-86db-b18108b3c0d4', '10ca9a1f-3f6c-4e95-861a-15f3fa33c004'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:32 devstack sudo[99863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:32 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:32 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" returned: 0 in 0.395s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:32 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1
Jul 31 14:57:32 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-be693a51-3b99-41a0-a560-acb54daaa0aa-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-be693a51-3b99-41a0-a560-acb54daaa0aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-be693a51-3b99-41a0-a560-acb54daaa0aa" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-be693a51-3b99-41a0-a560-acb54daaa0aa" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75c377-ec00-47ee-a778-fcf66cb4420c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:32 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.363s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:32 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Deleted volume successfully.
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1c91a84d-c9ee-468c-87fc-69a2e2c0ce63 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-f091409f-5413-48d5-8c29-92d8e6081600-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:33 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e.8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" returned: 0 in 0.446s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:33 devstack sudo[99868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa
Jul 31 14:57:33 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1" released by "_delete_snapshot" :: held 1.898s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" released by "delete_snapshot" :: held 1.931s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Created reservations ['ac3407fc-064f-494b-b58e-2430c3301caa', 'b04b6f4d-73ac-4252-aa9d-0c55f9609a5a', '7e7a1b82-3370-4ea1-87f1-8d364b4f146a', 'ab85ab02-c184-4126-b1f8-94a7a6afb280'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Delete snapshot completed successfully.
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6cabb465-f8e3-4ec3-9b19-4f625885a36e tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-8e21d7f0-4f4d-41db-94c0-9d510f9eb4f1-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:33 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa" returned: 0 in 0.505s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:33 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa
Jul 31 14:57:33 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:33 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-be693a51-3b99-41a0-a560-acb54daaa0aa" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-be693a51-3b99-41a0-a560-acb54daaa0aa" released by "delete_volume" :: held 0.842s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created reservations ['3d909988-db2e-4fc6-9402-43f98fb75eaa', '3d575e01-33c5-49b4-9ba6-43d432247346', 'f69baee1-dfd7-4d0f-bb5f-bb643c551ec0', '52e687ea-aa67-45ab-bed9-80982a7ca630'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:33 devstack sudo[99879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:33 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-deb4c8e7-ed29-4683-a886-d1cdf4f8da37-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-deb4c8e7-ed29-4683-a886-d1cdf4f8da37-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-deb4c8e7-ed29-4683-a886-d1cdf4f8da37" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-deb4c8e7-ed29-4683-a886-d1cdf4f8da37" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec31de-bcfe-4660-b775-92224bddeb9f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:34 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.382s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Deleted volume successfully.
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c8e57d39-fea2-446d-83a0-8cb4b035f615 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-be693a51-3b99-41a0-a560-acb54daaa0aa-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:34 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37
Jul 31 14:57:34 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-2cf491cb-f86b-48e9-85db-cc656a98af2e-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-2cf491cb-f86b-48e9-85db-cc656a98af2e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[104812e7-60ca-4b49-8cbc-6a53cf02ee28]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:34 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37" returned: 0 in 0.484s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:34 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37
Jul 31 14:57:34 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:34 devstack sudo[99888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e
Jul 31 14:57:34 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:35 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-deb4c8e7-ed29-4683-a886-d1cdf4f8da37" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-deb4c8e7-ed29-4683-a886-d1cdf4f8da37" released by "delete_volume" :: held 0.882s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created reservations ['6bac1a12-1873-4200-8801-5a1e3aad7cc2', '2d606999-7d82-40b7-a4da-74f837ca62aa', 'f6bd1d7e-74d3-45b8-877e-09da273de71d', '97e8c5f7-2658-4c55-a04c-1275b6cfecd3'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:35 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e" returned: 0 in 0.515s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:35 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e
Jul 31 14:57:35 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:35 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:35 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-4678dcb1-9c8c-4486-be3c-86e230f8dd77-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-4678dcb1-9c8c-4486-be3c-86e230f8dd77-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-4678dcb1-9c8c-4486-be3c-86e230f8dd77" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-4678dcb1-9c8c-4486-be3c-86e230f8dd77" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea895958-bc2c-4c68-9c7d-14cfed44fce2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:35 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2cf491cb-f86b-48e9-85db-cc656a98af2e" returned: 0 in 0.436s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-quobyte-2cf491cb-f86b-48e9-85db-cc656a98af2e" released by "delete_volume" :: held 1.056s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:35 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77
Jul 31 14:57:35 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:35 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.488s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Deleted volume successfully.
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28c7e734-f069-4256-9ee0-50f6d2284b1d tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-deb4c8e7-ed29-4683-a886-d1cdf4f8da37-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Created reservations ['236cc1f9-f26f-450e-a213-233e2cfc46e2', '3a2fd7a2-d614-4441-a969-a3dad0ac266d', '729eed1f-c8fe-4b6e-a59f-9c5b3a978ac9', '8f945fc4-3718-4a67-899f-0981ffd9823e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:35 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:35 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:36 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77" returned: 0 in 0.559s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:36 devstack sudo[99910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77
Jul 31 14:57:36 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:36 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.378s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Deleted volume successfully.
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-59112d46-e69a-49e5-a78f-c6ce86bc2218 tempest-VolumesSnapshotListTestJSON-1200832113 None] Lock "cinder-2cf491cb-f86b-48e9-85db-cc656a98af2e-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:36 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4678dcb1-9c8c-4486-be3c-86e230f8dd77" returned: 0 in 0.314s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-4678dcb1-9c8c-4486-be3c-86e230f8dd77" released by "delete_volume" :: held 0.955s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created reservations ['bc65c8a2-72f5-45e2-9212-3e381bb186ec', '696dc141-8f95-4c6b-a261-f0b79490b3d1', '80a3ff14-d0fa-40df-bd36-a1bcfad421e4', '7587add0-6dfd-4c68-970d-cad5e29bb098'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:36 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:36 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:36 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.289s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Deleted volume successfully.
Jul 31 14:57:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-89c770ee-e904-4334-9b93-8baaecad593b tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-4678dcb1-9c8c-4486-be3c-86e230f8dd77-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-893029f1-c6e8-473c-81bf-97687026a5b3-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-893029f1-c6e8-473c-81bf-97687026a5b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-02d3f256-df3f-49bf-960d-32e6bda424b8" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-02d3f256-df3f-49bf-960d-32e6bda424b8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-893029f1-c6e8-473c-81bf-97687026a5b3" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-893029f1-c6e8-473c-81bf-97687026a5b3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Deleting offline snapshot 893029f1-c6e8-473c-81bf-97687026a5b3 of volume 02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] snapshot_file for this snap is: volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2704068-78fd-4d47-bde1-9b42d8d8290a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:37 devstack sudo[99917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3
Jul 31 14:57:37 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:38 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3" returned: 0 in 0.547s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d3f256-df3f-49bf-960d-32e6bda424b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:38 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9cf3e2-d4f1-48cd-8af6-0f9cf49d15f5]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:38 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8
Jul 31 14:57:38 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:38 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8" returned: 0 in 0.529s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:38 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3
Jul 31 14:57:38 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:39 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3" returned: 0 in 0.490s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:39 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3
Jul 31 14:57:39 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:39 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8.893029f1-c6e8-473c-81bf-97687026a5b3" returned: 0 in 0.273s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-893029f1-c6e8-473c-81bf-97687026a5b3" released by "_delete_snapshot" :: held 1.991s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-02d3f256-df3f-49bf-960d-32e6bda424b8" released by "delete_snapshot" :: held 2.026s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:39 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created reservations ['94476a3e-d8bd-4731-b8be-2a380cdc77d7', '5f662412-3ba0-4e05-8b9c-1b3f1ac7b5f0', 'f23f7dcc-9d05-4554-bac3-a2c074bbc06f', 'f7331e80-7c46-4046-bff3-d555e7b86915'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Delete snapshot completed successfully.
Jul 31 14:57:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c64bfbc3-48e5-45ce-b9a7-96fde2afcc96 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-893029f1-c6e8-473c-81bf-97687026a5b3-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-02d3f256-df3f-49bf-960d-32e6bda424b8-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8ca79d51-3e80-4eff-ae7d-3b51f482b5cf tempest-GroupSnapshotsTest-956376216 None] Group tempest-GroupSnapshotsTest-Group-1743158463: creating
Jul 31 14:57:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-02d3f256-df3f-49bf-960d-32e6bda424b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8ca79d51-3e80-4eff-ae7d-3b51f482b5cf tempest-GroupSnapshotsTest-956376216 None] Group tempest-GroupSnapshotsTest-Group-1743158463: created successfully
Jul 31 14:57:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8ca79d51-3e80-4eff-ae7d-3b51f482b5cf tempest-GroupSnapshotsTest-956376216 None] Create group completed successfully.
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "cinder-quobyte-02d3f256-df3f-49bf-960d-32e6bda424b8" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-02d3f256-df3f-49bf-960d-32e6bda424b8" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a76368-aacd-4361-b790-c5cf75d5bc05]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:41 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8
Jul 31 14:57:41 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:41 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8" returned: 0 in 0.434s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:41 devstack sudo[99943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8
Jul 31 14:57:41 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:41 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-02d3f256-df3f-49bf-960d-32e6bda424b8" returned: 0 in 0.301s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-quobyte-02d3f256-df3f-49bf-960d-32e6bda424b8" released by "delete_volume" :: held 0.820s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:41 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Created reservations ['c3b8e6e4-d26f-4cfd-b71d-ddf652041082', '0de5639b-4d09-4b97-bac5-e1b67c0b3071', 'e72eaf95-752e-4b7c-8159-fb327e95932c', '1bdd2684-79c7-4d2f-888e-3320b1f4f6e1'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:42 devstack sudo[99946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:42 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:42 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.315s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:42 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Deleted volume successfully.
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-26580a0a-9a65-4cde-a95a-df6b68f4d431 tempest-CreateVolumesFromSnapshotTest-1023301340 None] Lock "cinder-02d3f256-df3f-49bf-960d-32e6bda424b8-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:42 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (5ca22823-1421-4627-ace4-fcd2a7d52ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7ae0b8-f97a-445c-a3f4-acc3f2eb08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7ae0b8-f97a-445c-a3f4-acc3f2eb08ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1362351356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0bcf9990-5146-41cf-9644-63801ebfce87,host='devstack@QuobyteHD#QuobyteHD',id=4b984515-fca1-4db2-849c-812df0ad5a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:43Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03728a56-372b-4679-9f76-c074847c91c5),volume_type_id=03728a56-372b-4679-9f76-c074847c91c5)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddb306c-163a-4e54-b5ea-0c5fee2438d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddb306c-163a-4e54-b5ea-0c5fee2438d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa14b280-0249-4b05-ae7a-dd8f82d4cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa14b280-0249-4b05-ae7a-dd8f82d4cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b984515-fca1-4db2-849c-812df0ad5a37', 'volume_name': 'volume-4b984515-fca1-4db2-849c-812df0ad5a37', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6aeac2-81fc-40a0-8d6c-ff2e15cc4d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6aeac2-81fc-40a0-8d6c-ff2e15cc4d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b9a940-b02e-4942-a3bc-9f30de294986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:43 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Volume 4b984515-fca1-4db2-849c-812df0ad5a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b984515-fca1-4db2-849c-812df0ad5a37', 'volume_size': 1}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0bcf9990-5146-41cf-9644-63801ebfce87,created_at=2026-07-31T12:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1362351356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0bcf9990-5146-41cf-9644-63801ebfce87,host='devstack@QuobyteHD#QuobyteHD',id=4b984515-fca1-4db2-849c-812df0ad5a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:43Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03728a56-372b-4679-9f76-c074847c91c5),volume_type_id=03728a56-372b-4679-9f76-c074847c91c5)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Creating volume 4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:43 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:43 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 1073741824
Jul 31 14:57:43 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:43 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 1073741824" returned: 0 in 0.584s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:43 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37
Jul 31 14:57:43 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:44 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37" returned: 0 in 0.445s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b9a940-b02e-4942-a3bc-9f30de294986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b984515-fca1-4db2-849c-812df0ad5a37', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e25ae7-825c-4f2e-9193-4304842774a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:44 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Volume volume-4b984515-fca1-4db2-849c-812df0ad5a37 (4b984515-fca1-4db2-849c-812df0ad5a37): created successfully
Jul 31 14:57:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e25ae7-825c-4f2e-9193-4304842774a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (5ca22823-1421-4627-ace4-fcd2a7d52ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:44 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6da0e862-479e-4106-892a-9547209b6099 tempest-GroupSnapshotsTest-956376216 None] Created volume successfully.
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Flow 'volume_create_manager' (5356e55a-408c-4235-a5e9-fa051f2d1632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a816563f-6d8f-41a5-9681-ec0b5e8a6506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a816563f-6d8f-41a5-9681-ec0b5e8a6506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-271405564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33204826-b033-42e1-8aa0-20e85558cf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed8056fe7dd43ff931003229e2f1b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:45Z,use_quota=True,user_id='c1b0b2e83719454d894236dcd42b8bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424c1bbf-62a6-4daf-a8f3-80e47bdb5bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424c1bbf-62a6-4daf-a8f3-80e47bdb5bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48822c4d-0f30-4721-900f-4acb2c55b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48822c4d-0f30-4721-900f-4acb2c55b2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33204826-b033-42e1-8aa0-20e85558cf3a', 'volume_name': 'volume-33204826-b033-42e1-8aa0-20e85558cf3a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faec703-4f75-42cf-8285-72358108c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faec703-4f75-42cf-8285-72358108c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68568325-0995-4156-9e1f-95d0d5c3dc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:45 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Volume 33204826-b033-42e1-8aa0-20e85558cf3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33204826-b033-42e1-8aa0-20e85558cf3a', 'volume_size': 1}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-271405564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33204826-b033-42e1-8aa0-20e85558cf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed8056fe7dd43ff931003229e2f1b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:45Z,use_quota=True,user_id='c1b0b2e83719454d894236dcd42b8bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Creating volume 33204826-b033-42e1-8aa0-20e85558cf3a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:45 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:45 devstack sudo[99959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a 1073741824
Jul 31 14:57:45 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] GroupSnapshot 575e3bf4-dc9b-4727-8894-fcae84abd2af: creating.
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Group snapshot 575e3bf4-dc9b-4727-8894-fcae84abd2af: creating. {{(pid=88594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:45 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a 1073741824" returned: 0 in 0.594s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:45 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a
Jul 31 14:57:46 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Flow 'volume_create_manager' (36d89bc1-60df-43db-bf93-0cb60587c94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112fad93-afa1-4550-b17a-4138c8e9d6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112fad93-afa1-4550-b17a-4138c8e9d6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1419204169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947fd6b0-f37d-400f-9a68-f4f474ea08c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed24ec88e55d43e99d30812879e999fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:46Z,use_quota=True,user_id='a7262febe79b4975b87f992bcc094daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29bda3e-6aba-4d56-9c20-af8b84d02fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29bda3e-6aba-4d56-9c20-af8b84d02fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:46 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef115e3f-bc38-4d75-9a25-537d68cde44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef115e3f-bc38-4d75-9a25-537d68cde44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947fd6b0-f37d-400f-9a68-f4f474ea08c4', 'volume_name': 'volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a899d26-a951-49e2-94f7-146e309b6d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a899d26-a951-49e2-94f7-146e309b6d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7413799-2b1d-4282-b402-b6698bd46148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:46 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Volume 947fd6b0-f37d-400f-9a68-f4f474ea08c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4', 'volume_size': 1}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a" returned: 0 in 0.408s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.500s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68568325-0995-4156-9e1f-95d0d5c3dc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33204826-b033-42e1-8aa0-20e85558cf3a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71332d69-080c-4869-b1e3-eb34aaabe9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Creating offline snapshot a4485aed-8c3d-41ce-91b2-ffcce736b504 of volume 4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:57:46 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Volume volume-33204826-b033-42e1-8aa0-20e85558cf3a (33204826-b033-42e1-8aa0-20e85558cf3a): created successfully
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71332d69-080c-4869-b1e3-eb34aaabe9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Flow 'volume_create_manager' (5356e55a-408c-4235-a5e9-fa051f2d1632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e07fc5-94bf-4df3-a85a-9c887949bc71]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:46 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ba253170-c772-4f7d-ad80-3f99550bc1a3 tempest-VolumeQuotasAdminTestJSON-594629654 None] Created volume successfully.
Jul 31 14:57:46 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37
Jul 31 14:57:46 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:46 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37" returned: 0 in 0.426s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:46 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 1G
Jul 31 14:57:46 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Acquiring lock "cinder-33204826-b033-42e1-8aa0-20e85558cf3a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "cinder-33204826-b033-42e1-8aa0-20e85558cf3a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Acquiring lock "cinder-quobyte-33204826-b033-42e1-8aa0-20e85558cf3a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:47 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 1G" returned: 0 in 0.497s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b984515-fca1-4db2-849c-812df0ad5a37 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "cinder-quobyte-33204826-b033-42e1-8aa0-20e85558cf3a" acquired by "delete_volume" :: waited 0.040s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:47 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b984515-fca1-4db2-849c-812df0ad5a37 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504
Jul 31 14:57:47 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fd098-5bb7-4a5a-9c2c-39a710b0989f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:47 devstack sudo[99981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a
Jul 31 14:57:47 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:47 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b984515-fca1-4db2-849c-812df0ad5a37 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504" returned: 0 in 0.336s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:47 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:47 devstack sudo[99987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504
Jul 31 14:57:47 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:47 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a" returned: 0 in 0.441s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:47 devstack sudo[99992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a
Jul 31 14:57:47 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:48 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504" returned: 0 in 0.278s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:48 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.info
Jul 31 14:57:48 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:48 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-33204826-b033-42e1-8aa0-20e85558cf3a" returned: 0 in 0.337s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "cinder-quobyte-33204826-b033-42e1-8aa0-20e85558cf3a" released by "delete_volume" :: held 0.822s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Created reservations ['1086c8eb-09ef-45e1-88c6-abe9647e75b4', 'eb66752d-bea6-44d6-98fe-7a02071d19e3', 'e3635465-2a52-4a7b-97e2-adda645c83c2', '991889b8-d640-4ccf-a4eb-2c15500730b2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:48 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.info" returned: 0 in 0.314s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:48 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:48 devstack sudo[99999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.info
Jul 31 14:57:48 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:48 devstack sudo[100001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:48 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:48 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.info" returned: 0 in 0.312s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1419204169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947fd6b0-f37d-400f-9a68-f4f474ea08c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed24ec88e55d43e99d30812879e999fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:46Z,use_quota=True,user_id='a7262febe79b4975b87f992bcc094daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Creating volume 947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:48 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:48 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 1073741824
Jul 31 14:57:48 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-451e07b7-7b9c-4f07-a650-d227d73c318f tempest-GroupSnapshotsTest-956376216 None] group_snapshot 575e3bf4-dc9b-4727-8894-fcae84abd2af: created successfully
Jul 31 14:57:48 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.505s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Deleted volume successfully.
Jul 31 14:57:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a0e7539c-2c9b-4f58-bae6-b4082ef3a3ce tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "cinder-33204826-b033-42e1-8aa0-20e85558cf3a-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:49 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 1073741824" returned: 0 in 0.623s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=147,cinder:UPDATE=200,cinder:DELETE=15,cinder:INSERT=51 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=167,cinder:UPDATE=190,cinder:INSERT=43,cinder:DELETE=16 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Flow 'volume_create_manager' (ba9962d3-7660-4629-adb6-285524686ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11d85e8-cb54-4dba-beda-6cc63bba8bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11d85e8-cb54-4dba-beda-6cc63bba8bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1682249866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9818e073-7f1c-4576-8050-bf91c226194e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed8056fe7dd43ff931003229e2f1b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:49Z,use_quota=True,user_id='c1b0b2e83719454d894236dcd42b8bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:49 devstack sudo[100013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4
Jul 31 14:57:49 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f89b1e6-dcdf-4342-ac7b-3c036cf3836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f89b1e6-dcdf-4342-ac7b-3c036cf3836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48af75e2-0b9b-449a-9a99-8e713d7c3d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48af75e2-0b9b-449a-9a99-8e713d7c3d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9818e073-7f1c-4576-8050-bf91c226194e', 'volume_name': 'volume-9818e073-7f1c-4576-8050-bf91c226194e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cdbd43-feb8-407e-98e6-0a1f8b125e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cdbd43-feb8-407e-98e6-0a1f8b125e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a184a7-9a19-4fec-8a21-d96b4a47d122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:49 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Volume 9818e073-7f1c-4576-8050-bf91c226194e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9818e073-7f1c-4576-8050-bf91c226194e', 'volume_size': 1}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:49 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.212s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1682249866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9818e073-7f1c-4576-8050-bf91c226194e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed8056fe7dd43ff931003229e2f1b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:57:49Z,use_quota=True,user_id='c1b0b2e83719454d894236dcd42b8bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Creating volume 9818e073-7f1c-4576-8050-bf91c226194e {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:49 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7413799-2b1d-4282-b402-b6698bd46148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:49 devstack sudo[100016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e 1073741824
Jul 31 14:57:49 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966fbb34-e3a1-462a-9dde-a4803270eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:49 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Volume volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 (947fd6b0-f37d-400f-9a68-f4f474ea08c4): created successfully
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966fbb34-e3a1-462a-9dde-a4803270eede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Flow 'volume_create_manager' (36d89bc1-60df-43db-bf93-0cb60587c94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d672f2ac-4440-4e98-b045-41daad5bd746 tempest-VolumeDependencyTests-1357464911 None] Created volume successfully.
Jul 31 14:57:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:50 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e 1073741824" returned: 0 in 0.595s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:50 devstack sudo[100022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e
Jul 31 14:57:50 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:50 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e" returned: 0 in 0.301s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.719s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-a4485aed-8c3d-41ce-91b2-ffcce736b504-5f20a67e-7036-43f6-891f-8d1f88662a7f" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a184a7-9a19-4fec-8a21-d96b4a47d122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9818e073-7f1c-4576-8050-bf91c226194e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8abd78d-df77-4a92-b385-7b65b44c3e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-a4485aed-8c3d-41ce-91b2-ffcce736b504-5f20a67e-7036-43f6-891f-8d1f88662a7f" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Creating volume 5f20a67e-7036-43f6-891f-8d1f88662a7f from snapshot a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-5f20a67e-7036-43f6-891f-8d1f88662a7f" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:50 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Volume volume-9818e073-7f1c-4576-8050-bf91c226194e (9818e073-7f1c-4576-8050-bf91c226194e): created successfully
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8abd78d-df77-4a92-b385-7b65b44c3e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Flow 'volume_create_manager' (ba9962d3-7660-4629-adb6-285524686ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-5f20a67e-7036-43f6-891f-8d1f88662a7f" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] snapshot: a4485aed-8c3d-41ce-91b2-ffcce736b504, volume: 5f20a67e-7036-43f6-891f-8d1f88662a7f,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 14:57:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4c2e0637-26a8-4372-9dc0-f2c57686879a tempest-VolumeQuotasAdminTestJSON-594629654 None] Created volume successfully.
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f49809-b726-477e-92b8-a1c44abdc10e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:50 devstack sudo[100025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504
Jul 31 14:57:50 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:51 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504" returned: 0 in 0.435s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b984515-fca1-4db2-849c-812df0ad5a37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c3b72-da7b-4061-abaa-cb68f4dc519c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:51 devstack sudo[100030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37
Jul 31 14:57:51 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:51 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37" returned: 0 in 0.491s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 14:57:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:51 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f
Jul 31 14:57:51 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:52 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6674ac5f-7fa9-47af-9453-290316392e03 tempest-VolumeQuotasAdminTestJSON-1692315025 None] Transfer volume completed successfully.
Jul 31 14:57:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Acquiring lock "cinder-9818e073-7f1c-4576-8050-bf91c226194e-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Lock "cinder-9818e073-7f1c-4576-8050-bf91c226194e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Acquiring lock "cinder-quobyte-9818e073-7f1c-4576-8050-bf91c226194e" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Lock "cinder-quobyte-9818e073-7f1c-4576-8050-bf91c226194e" acquired by "delete_volume" :: waited 0.043s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:53 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4004b7-430f-4e0d-9732-0a38dec176c4]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:54 devstack sudo[100048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e
Jul 31 14:57:54 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:54 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e" returned: 0 in 1.152s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:54 devstack sudo[100054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e
Jul 31 14:57:54 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:55 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9818e073-7f1c-4576-8050-bf91c226194e" returned: 0 in 0.733s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Lock "cinder-quobyte-9818e073-7f1c-4576-8050-bf91c226194e" released by "delete_volume" :: held 2.019s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:55 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Created reservations ['e52dbed6-0c49-46dc-afd3-e83ad7575368', 'd1f31cea-6546-49d8-81ba-8432d364e9c4', '86aa0086-d23e-43eb-9296-e8c79fb996a2', 'e56c3fde-c2ee-4a6a-86e9-947fe0b323f8'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:56 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:56 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:56 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.578s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:56 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Deleted volume successfully.
Jul 31 14:57:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-735ca1ba-8c00-4e0b-8369-6ca8d2a200ab tempest-VolumeQuotasAdminTestJSON-1397361400 None] Lock "cinder-9818e073-7f1c-4576-8050-bf91c226194e-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:57 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f" returned: 0 in 5.549s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:57:57 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Converted 1024.00 MB image at 184.49 MB/s
Jul 31 14:57:57 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:57 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f
Jul 31 14:57:57 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:57 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-5f20a67e-7036-43f6-891f-8d1f88662a7f" released by "_copy_volume_from_snapshot" :: held 6.883s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-a4485aed-8c3d-41ce-91b2-ffcce736b504-5f20a67e-7036-43f6-891f-8d1f88662a7f" released by "_create_volume_from_snapshot" :: held 6.965s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.028s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Creating offline snapshot e2d458d8-95c5-4b30-82f7-54e493abcf7a of volume 947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[879258c7-9a22-4d02-9a45-3a96d85c263d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-201b6e04-27f6-4bff-b25f-78d9e0898572 tempest-GroupSnapshotsTest-956376216 None] Create group from source-snapshot-575e3bf4-dc9b-4727-8894-fcae84abd2af completed successfully.
Jul 31 14:57:57 devstack sudo[100063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4
Jul 31 14:57:57 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:57:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:58 devstack sudo[100065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:57:58 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:58 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4" returned: 0 in 0.434s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:58 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a 1G
Jul 31 14:57:58 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:58 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.328s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:57:58 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a 1G" returned: 0 in 0.606s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:58 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a
Jul 31 14:57:58 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-5f20a67e-7036-43f6-891f-8d1f88662a7f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-5f20a67e-7036-43f6-891f-8d1f88662a7f" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0986c-b477-41e8-8dc6-5ab356db61a7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:59 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a" returned: 0 in 0.359s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:59 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a is being set with open permissions: ugo+rw
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:59 devstack sudo[100082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a
Jul 31 14:57:59 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:59 devstack sudo[100081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f
Jul 31 14:57:59 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:59 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a" returned: 0 in 0.302s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:59 devstack sudo[100089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.info
Jul 31 14:57:59 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:59 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f" returned: 0 in 0.436s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:59 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f
Jul 31 14:57:59 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:59 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.info" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:59 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.info is being set with open permissions: ugo+rw
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:57:59 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.info
Jul 31 14:57:59 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:57:59 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f20a67e-7036-43f6-891f-8d1f88662a7f" returned: 0 in 0.295s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-5f20a67e-7036-43f6-891f-8d1f88662a7f" released by "delete_volume" :: held 0.791s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:57:59 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['a508de5b-d4f0-4f86-a486-c759a87f7bf1'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:57:59 devstack cinder-volume[88594]: WARNING cinder.quota [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-594092247 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-594092247, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:00 devstack cinder-volume[88594]: WARNING cinder.quota [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-594092247 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-594092247, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['abb8b171-cf88-461b-a088-85ad103ead5a', '2e347250-caa2-4d22-9393-dba9676c9c48', '0d7804a6-4578-40a1-8f1c-a8b3215712ce', '013de486-a405-4ee2-8e80-78d65dad93e0'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:00 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.info" returned: 0 in 0.303s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-cb923df7-eea3-4c2d-9f68-96b44909991b tempest-VolumeDependencyTests-1357464911 None] Create snapshot completed successfully
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:00 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:00 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:00 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.356s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] group_snapshot 575e3bf4-dc9b-4727-8894-fcae84abd2af: deleting
Jul 31 14:58:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a5321828-9a41-47a4-b7ff-c3817bce74b4 tempest-GroupSnapshotsTest-956376216 None] Delete group completed successfully.
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] group_snapshot 575e3bf4-dc9b-4727-8894-fcae84abd2af: deleting {{(pid=88594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-4b984515-fca1-4db2-849c-812df0ad5a37" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4b984515-fca1-4db2-849c-812df0ad5a37" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-a4485aed-8c3d-41ce-91b2-ffcce736b504" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-a4485aed-8c3d-41ce-91b2-ffcce736b504" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Deleting offline snapshot a4485aed-8c3d-41ce-91b2-ffcce736b504 of volume 4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] snapshot_file for this snap is: volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e2eab6-8277-466f-81bc-73b153b7c23e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:00 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504
Jul 31 14:58:00 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Flow 'volume_create_manager' (a665e42a-ca93-4c1a-bc34-2e167c56caa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bc3791-a28a-4b4b-ba6d-696e2afc7278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bc3791-a28a-4b4b-ba6d-696e2afc7278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2005074854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00e31fa-52be-4033-9d0e-f361e616d7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed24ec88e55d43e99d30812879e999fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2d458d8-95c5-4b30-82f7-54e493abcf7a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:01Z,use_quota=True,user_id='a7262febe79b4975b87f992bcc094daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5550385-d3c9-477f-a559-a6586d1f1e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5550385-d3c9-477f-a559-a6586d1f1e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5572b270-da1f-4acf-8778-5abbcdc9961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5572b270-da1f-4acf-8778-5abbcdc9961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a00e31fa-52be-4033-9d0e-f361e616d7b8', 'volume_name': 'volume-a00e31fa-52be-4033-9d0e-f361e616d7b8', 'volume_size': 1, 'snapshot_id': 'e2d458d8-95c5-4b30-82f7-54e493abcf7a'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e439e3dd-3ad4-4746-9ed0-bcd4e73e7a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e439e3dd-3ad4-4746-9ed0-bcd4e73e7a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:01 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5885fd2-607b-4a38-9044-247173b3e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:01 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Volume a00e31fa-52be-4033-9d0e-f361e616d7b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a00e31fa-52be-4033-9d0e-f361e616d7b8', 'volume_size': 1, 'snapshot_id': 'e2d458d8-95c5-4b30-82f7-54e493abcf7a'}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504" returned: 0 in 0.476s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b984515-fca1-4db2-849c-812df0ad5a37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-quobyte-e2d458d8-95c5-4b30-82f7-54e493abcf7a-a00e31fa-52be-4033-9d0e-f361e616d7b8" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd49f04a-ae54-459a-be81-707a1379e5cf]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-e2d458d8-95c5-4b30-82f7-54e493abcf7a-a00e31fa-52be-4033-9d0e-f361e616d7b8" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Creating volume a00e31fa-52be-4033-9d0e-f361e616d7b8 from snapshot e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-quobyte-a00e31fa-52be-4033-9d0e-f361e616d7b8" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-a00e31fa-52be-4033-9d0e-f361e616d7b8" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] snapshot: e2d458d8-95c5-4b30-82f7-54e493abcf7a, volume: a00e31fa-52be-4033-9d0e-f361e616d7b8,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef42c417-7c88-4fb4-b93c-fde161285156]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:01 devstack sudo[100107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37
Jul 31 14:58:01 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:01 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a
Jul 31 14:58:01 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:02 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:02 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37" returned: 0 in 0.656s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a" returned: 0 in 0.512s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:02 devstack sudo[100117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504
Jul 31 14:58:02 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff68335-6dc2-4d6c-b24a-a16b19f78a6d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:02 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4
Jul 31 14:58:02 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:02 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504" returned: 0 in 0.539s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:02 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504
Jul 31 14:58:02 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:02 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4" returned: 0 in 0.561s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:02 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8
Jul 31 14:58:02 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:02 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37.a4485aed-8c3d-41ce-91b2-ffcce736b504" returned: 0 in 0.350s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-a4485aed-8c3d-41ce-91b2-ffcce736b504" released by "_delete_snapshot" :: held 2.156s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4b984515-fca1-4db2-849c-812df0ad5a37" released by "delete_snapshot" :: held 2.199s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:03 devstack cinder-volume[88594]: WARNING cinder.quota [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-594092247 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-594092247, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:03 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] Created reservations ['8c9f6084-7865-4ea5-9509-6177b5d920bf', 'bf772aa6-b8da-4e43-95af-516cd9893379', '4738fbca-5ed2-42d5-882f-ccd2917f1779', '2ec95319-a75d-4d79-888a-cdfb450afaa8'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:03 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-60b2ebb5-e70d-4781-9678-afa6b408ce9e tempest-GroupSnapshotsTest-956376216 None] group_snapshot 575e3bf4-dc9b-4727-8894-fcae84abd2af: deleted successfully
Jul 31 14:58:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-4b984515-fca1-4db2-849c-812df0ad5a37" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4b984515-fca1-4db2-849c-812df0ad5a37" acquired by "delete_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:05 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf981928-b6ba-44d1-9446-0b7cd99f21e4]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:05 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37
Jul 31 14:58:05 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:06 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37" returned: 0 in 0.975s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:06 devstack sudo[100152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37
Jul 31 14:58:06 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:07 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4b984515-fca1-4db2-849c-812df0ad5a37" returned: 0 in 0.933s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4b984515-fca1-4db2-849c-812df0ad5a37" released by "delete_volume" :: held 2.101s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['b06217ed-5906-4775-bd73-2e0497709df5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:07 devstack cinder-volume[88594]: WARNING cinder.db.api [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-594092247']
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['642a27c7-3bb5-427b-95c0-258aa46299af', 'f163e7c1-1962-45cb-b9d6-e7fd618d436c', 'f3f4dd24-5b77-4722-af4d-15e3c4198a0e', '526e0f9c-f220-4ed8-997d-27e214b6f8a1'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:07 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:07 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:08 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.700s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:08 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:08 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fdcad336-8e2e-4dca-8da0-74d4f45dde36 tempest-GroupSnapshotsTest-956376216 None] Delete group completed successfully.
Jul 31 14:58:09 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8" returned: 0 in 6.479s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:58:09 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Converted 1024.00 MB image at 158.03 MB/s
Jul 31 14:58:09 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 is being set with open permissions: ugo+rw
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:09 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8
Jul 31 14:58:09 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:09 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8" returned: 0 in 0.326s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-598051cf-547f-4f8d-9f0a-8172620bc279 tempest-GroupSnapshotsTest-956376216 None] Group tempest-GroupSnapshotsTest-Group-2115581088: creating
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-a00e31fa-52be-4033-9d0e-f361e616d7b8" released by "_copy_volume_from_snapshot" :: held 8.031s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-598051cf-547f-4f8d-9f0a-8172620bc279 tempest-GroupSnapshotsTest-956376216 None] Group tempest-GroupSnapshotsTest-Group-2115581088: created successfully
Jul 31 14:58:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-598051cf-547f-4f8d-9f0a-8172620bc279 tempest-GroupSnapshotsTest-956376216 None] Create group completed successfully.
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-e2d458d8-95c5-4b30-82f7-54e493abcf7a-a00e31fa-52be-4033-9d0e-f361e616d7b8" released by "_create_volume_from_snapshot" :: held 8.128s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.163s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5885fd2-607b-4a38-9044-247173b3e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00e31fa-52be-4033-9d0e-f361e616d7b8', 'volume_size': 1, 'snapshot_id': 'e2d458d8-95c5-4b30-82f7-54e493abcf7a'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f6d8b5-5a92-44a1-a4eb-615548d5390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:09 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Volume volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 (a00e31fa-52be-4033-9d0e-f361e616d7b8): created successfully
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f6d8b5-5a92-44a1-a4eb-615548d5390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Flow 'volume_create_manager' (a665e42a-ca93-4c1a-bc34-2e167c56caa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7766971e-f330-4664-92d7-0f6d7d438383 tempest-VolumeDependencyTests-1357464911 None] Created volume successfully.
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Flow 'volume_create_manager' (deede39c-1023-45ef-a5d4-b14c62856726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8fb691-e1bd-4576-ace6-bb21f5d0398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-e2d458d8-95c5-4b30-82f7-54e493abcf7a-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8fb691-e1bd-4576-ace6-bb21f5d0398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2120046532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551cc9df-a53b-4eb1-bb75-af3a56b46f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d31a8d803b04f34b56d7ea9870c9032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:10Z,use_quota=True,user_id='df63156eca02466f9fef273cd898a528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4763256-e5ae-496c-bdbb-ebcbf1fd9b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4763256-e5ae-496c-bdbb-ebcbf1fd9b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6364b73-5555-41d6-9bd2-5218902057b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6364b73-5555-41d6-9bd2-5218902057b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551cc9df-a53b-4eb1-bb75-af3a56b46f16', 'volume_name': 'volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904b4b8d-90f1-4f1b-bb1f-abaa0e38d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904b4b8d-90f1-4f1b-bb1f-abaa0e38d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b448f3e5-59f4-410b-b2fb-99d4064cc232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Volume 551cc9df-a53b-4eb1-bb75-af3a56b46f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16', 'volume_size': 1}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2120046532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551cc9df-a53b-4eb1-bb75-af3a56b46f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d31a8d803b04f34b56d7ea9870c9032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:10Z,use_quota=True,user_id='df63156eca02466f9fef273cd898a528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Creating volume 551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:10 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-e2d458d8-95c5-4b30-82f7-54e493abcf7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.099s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-quobyte-947fd6b0-f37d-400f-9a68-f4f474ea08c4" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:10 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 1073741824
Jul 31 14:58:10 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-947fd6b0-f37d-400f-9a68-f4f474ea08c4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-quobyte-e2d458d8-95c5-4b30-82f7-54e493abcf7a" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-e2d458d8-95c5-4b30-82f7-54e493abcf7a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Deleting offline snapshot e2d458d8-95c5-4b30-82f7-54e493abcf7a of volume 947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] snapshot_file for this snap is: volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb2d912-7536-4838-99cd-8d1d6309be86]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:10 devstack sudo[100165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a
Jul 31 14:58:10 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:10 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:10 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 1073741824" returned: 0 in 0.570s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a" returned: 0 in 0.479s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef5a55-ad10-4dee-ab05-6a4cb3d1201a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:11 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16
Jul 31 14:58:11 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:11 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4
Jul 31 14:58:11 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (358576c0-1a1e-4aef-9b27-f3b1f06ca67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9871c5b9-922b-44a0-a6a9-20fe28331178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9871c5b9-922b-44a0-a6a9-20fe28331178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326013704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=741cdc2c-3a02-4cbd-9001-64657d2cf332,host='devstack@QuobyteHD#QuobyteHD',id=d074f3cd-a902-4e02-b411-a785dbd3e0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:11Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2626b6a2-21ee-4a18-a34e-eb4f4784ade9),volume_type_id=2626b6a2-21ee-4a18-a34e-eb4f4784ade9)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbfe5cc-1751-4100-a4e8-a43033b6f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbfe5cc-1751-4100-a4e8-a43033b6f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99424373-3aad-4525-b303-b003f28656dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99424373-3aad-4525-b303-b003f28656dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd074f3cd-a902-4e02-b411-a785dbd3e0c4', 'volume_name': 'volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29644ae5-3736-403e-9cfd-8e3233f22a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29644ae5-3736-403e-9cfd-8e3233f22a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d156a8-0726-49ae-a424-a9654fa13749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Volume d074f3cd-a902-4e02-b411-a785dbd3e0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4', 'volume_size': 1}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:11 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16" returned: 0 in 0.449s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.063s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=741cdc2c-3a02-4cbd-9001-64657d2cf332,created_at=2026-07-31T12:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326013704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=741cdc2c-3a02-4cbd-9001-64657d2cf332,host='devstack@QuobyteHD#QuobyteHD',id=d074f3cd-a902-4e02-b411-a785dbd3e0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:11Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2626b6a2-21ee-4a18-a34e-eb4f4784ade9),volume_type_id=2626b6a2-21ee-4a18-a34e-eb4f4784ade9)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Creating volume d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:11 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b448f3e5-59f4-410b-b2fb-99d4064cc232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6075f4c4-25ce-499e-acbf-0a9c8c299893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:11 devstack sudo[100182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 1073741824
Jul 31 14:58:11 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Volume volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 (551cc9df-a53b-4eb1-bb75-af3a56b46f16): created successfully
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6075f4c4-25ce-499e-acbf-0a9c8c299893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Flow 'volume_create_manager' (deede39c-1023-45ef-a5d4-b14c62856726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ab8846e8-e0d2-4863-9f54-15a1b47678a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Created volume successfully.
Jul 31 14:58:11 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4" returned: 0 in 0.684s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:11 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a
Jul 31 14:58:11 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:12 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 1073741824" returned: 0 in 0.602s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:12 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a" returned: 0 in 0.478s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:12 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4
Jul 31 14:58:12 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:12 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a
Jul 31 14:58:12 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:12 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4.e2d458d8-95c5-4b30-82f7-54e493abcf7a" returned: 0 in 0.337s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-e2d458d8-95c5-4b30-82f7-54e493abcf7a" released by "_delete_snapshot" :: held 2.120s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-947fd6b0-f37d-400f-9a68-f4f474ea08c4" released by "delete_snapshot" :: held 2.150s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:12 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4" returned: 0 in 0.451s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d156a8-0726-49ae-a424-a9654fa13749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b531315-9118-41a9-a2ca-de661ac7e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:12 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Volume volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 (d074f3cd-a902-4e02-b411-a785dbd3e0c4): created successfully
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b531315-9118-41a9-a2ca-de661ac7e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (358576c0-1a1e-4aef-9b27-f3b1f06ca67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-98bcbf14-6b2f-46b7-b685-13d3d5199a96 tempest-GroupSnapshotsTest-956376216 None] Created volume successfully.
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Created reservations ['dfefe143-9b68-4e82-90aa-8dd24b1c2d60', '14e7a37e-212b-4500-bce8-5c0585603ecc', '8a0ba542-d337-40d1-8170-91bbefec290b', '05caf185-3cf8-46b0-a53b-1f1a7516e582'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Creating offline snapshot 54c2e2d9-35c6-4156-91d5-520bf2425f96 of volume 551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17e4df-79dd-402d-9634-9fe4e396b754]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Delete snapshot completed successfully.
Jul 31 14:58:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fc928989-35c4-4a8e-bd6c-6df4b02e19c0 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-e2d458d8-95c5-4b30-82f7-54e493abcf7a-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:12 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16
Jul 31 14:58:12 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:13 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16" returned: 0 in 0.379s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:13 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 1G
Jul 31 14:58:13 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:13 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 1G" returned: 0 in 0.422s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:13 devstack sudo[100249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96
Jul 31 14:58:13 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-947fd6b0-f37d-400f-9a68-f4f474ea08c4-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-947fd6b0-f37d-400f-9a68-f4f474ea08c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-quobyte-947fd6b0-f37d-400f-9a68-f4f474ea08c4" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-947fd6b0-f37d-400f-9a68-f4f474ea08c4" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907e06f-cd88-4289-9e5e-1154a39b85c6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:14 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96" returned: 0 in 0.451s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:14 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 is being set with open permissions: ugo+rw
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:14 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96
Jul 31 14:58:14 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:14 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4
Jul 31 14:58:14 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:14 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96" returned: 0 in 0.330s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:14 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4" returned: 0 in 0.439s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:14 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4
Jul 31 14:58:14 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:14 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.info
Jul 31 14:58:14 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:14 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (9f749047-3a28-41ac-bcc9-2c54e2580846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c68af3-b389-470c-b484-7f8c1c5e23b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-947fd6b0-f37d-400f-9a68-f4f474ea08c4" returned: 0 in 0.470s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c68af3-b389-470c-b484-7f8c1c5e23b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827901216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=741cdc2c-3a02-4cbd-9001-64657d2cf332,host='devstack@QuobyteHD#QuobyteHD',id=4203ee78-0367-4bec-924d-f75acddd606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:15Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2626b6a2-21ee-4a18-a34e-eb4f4784ade9),volume_type_id=2626b6a2-21ee-4a18-a34e-eb4f4784ade9)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:14 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09197e91-cd94-4dcc-8b83-8cf56c004ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09197e91-cd94-4dcc-8b83-8cf56c004ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3acf820-f3d1-4b7e-979b-4cfe71f692d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3acf820-f3d1-4b7e-979b-4cfe71f692d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4203ee78-0367-4bec-924d-f75acddd606d', 'volume_name': 'volume-4203ee78-0367-4bec-924d-f75acddd606d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7904d1-1fa5-4fb5-8f63-e4a154ab1ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7904d1-1fa5-4fb5-8f63-e4a154ab1ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2212769-3106-4134-9eb2-4dffe0d9ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:14 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Volume 4203ee78-0367-4bec-924d-f75acddd606d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4203ee78-0367-4bec-924d-f75acddd606d', 'volume_size': 1}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-947fd6b0-f37d-400f-9a68-f4f474ea08c4" released by "delete_volume" :: held 1.048s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.info" returned: 0 in 0.493s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:14 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.info is being set with open permissions: ugo+rw
Jul 31 14:58:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:14 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.info
Jul 31 14:58:14 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Created reservations ['88fef35c-8443-40dd-8121-cbccef2e8793', '53447f9f-bf68-4c31-9f27-1ea70356fe3e', 'a01106d0-c782-4bb4-b353-9e21f8766dd6', 'f24d43d2-0f0e-4b3f-a9b3-58b49763408c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:15 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:15 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:15 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.info" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=741cdc2c-3a02-4cbd-9001-64657d2cf332,created_at=2026-07-31T12:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827901216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=741cdc2c-3a02-4cbd-9001-64657d2cf332,host='devstack@QuobyteHD#QuobyteHD',id=4203ee78-0367-4bec-924d-f75acddd606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:15Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2626b6a2-21ee-4a18-a34e-eb4f4784ade9),volume_type_id=2626b6a2-21ee-4a18-a34e-eb4f4784ade9)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Creating volume 4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:15 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:15 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d 1073741824
Jul 31 14:58:15 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:15 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e9f4c2c5-fec4-43e2-ab17-80081af871a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Create snapshot completed successfully
Jul 31 14:58:15 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:15 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Deleted volume successfully.
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eff3a9d5-3932-4d19-aabf-eac56db75762 tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-947fd6b0-f37d-400f-9a68-f4f474ea08c4-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:15 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d 1073741824" returned: 0 in 0.458s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:15 devstack sudo[100282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d
Jul 31 14:58:15 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:16 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d" returned: 0 in 0.319s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2212769-3106-4134-9eb2-4dffe0d9ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4203ee78-0367-4bec-924d-f75acddd606d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcf5780-d048-4011-9fa3-d82364d9f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:16 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Volume volume-4203ee78-0367-4bec-924d-f75acddd606d (4203ee78-0367-4bec-924d-f75acddd606d): created successfully
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcf5780-d048-4011-9fa3-d82364d9f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (9f749047-3a28-41ac-bcc9-2c54e2580846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-a00e31fa-52be-4033-9d0e-f361e616d7b8-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-353e016f-ad65-476c-9868-3de56188a2f7 tempest-GroupSnapshotsTest-956376216 None] Created volume successfully.
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-a00e31fa-52be-4033-9d0e-f361e616d7b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "cinder-quobyte-a00e31fa-52be-4033-9d0e-f361e616d7b8" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-a00e31fa-52be-4033-9d0e-f361e616d7b8" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf2a58a-5e5d-40c6-9761-84d5bdd500b9]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:16 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8
Jul 31 14:58:16 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "cinder-54c2e2d9-35c6-4156-91d5-520bf2425f96-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-54c2e2d9-35c6-4156-91d5-520bf2425f96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "cinder-quobyte-551cc9df-a53b-4eb1-bb75-af3a56b46f16" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-quobyte-551cc9df-a53b-4eb1-bb75-af3a56b46f16" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "cinder-quobyte-54c2e2d9-35c6-4156-91d5-520bf2425f96" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-quobyte-54c2e2d9-35c6-4156-91d5-520bf2425f96" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Deleting offline snapshot 54c2e2d9-35c6-4156-91d5-520bf2425f96 of volume 551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] snapshot_file for this snap is: volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd3eb00-e187-4ed9-8407-3dac593b8d8a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:16 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8" returned: 0 in 0.419s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:16 devstack sudo[100291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8
Jul 31 14:58:16 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:16 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96
Jul 31 14:58:16 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:16 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a00e31fa-52be-4033-9d0e-f361e616d7b8" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-quobyte-a00e31fa-52be-4033-9d0e-f361e616d7b8" released by "delete_volume" :: held 0.731s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:16 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96" returned: 0 in 0.390s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Created reservations ['ce988c86-2f1f-42f1-979a-8e431fa86ff8', '641cee1d-d577-45a6-bd43-d0ad7a334691', '20b82f8d-8e46-40a0-8be9-25a46c0740be', '4c423d33-1c0c-4744-b9c8-7b21141ceb4d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f5ffd-43ec-47a0-83ee-c125ff454f64]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:17 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:17 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:17 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16
Jul 31 14:58:17 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:17 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-16a9fe15-e7dc-4b8e-8a59-82dd23f3ed64 tempest-GroupSnapshotsTest-956376216 None] Update group completed successfully.
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.337s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Deleted volume successfully.
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d4bf2988-a1bc-44f6-8777-3f27f016b2ea tempest-VolumeDependencyTests-1357464911 None] Lock "cinder-a00e31fa-52be-4033-9d0e-f361e616d7b8-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:17 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16" returned: 0 in 0.575s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:17 devstack sudo[100306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96
Jul 31 14:58:17 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:18 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96" returned: 0 in 0.406s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:18 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96
Jul 31 14:58:18 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:18 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16.54c2e2d9-35c6-4156-91d5-520bf2425f96" returned: 0 in 0.293s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-quobyte-54c2e2d9-35c6-4156-91d5-520bf2425f96" released by "_delete_snapshot" :: held 1.798s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-quobyte-551cc9df-a53b-4eb1-bb75-af3a56b46f16" released by "delete_snapshot" :: held 1.827s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Created reservations ['a7390b93-1d4f-4c6a-8bf6-ae550af9cc26', '830f9810-64e7-4968-8724-ad8694b1dd77', 'da401703-6a55-439f-b292-97a1c6f37a12', 'ca9b4e46-0118-49f4-bb68-9cfb0e182734'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Delete snapshot completed successfully.
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4bab419e-fa97-44ef-9e83-dcfbb56294db tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-54c2e2d9-35c6-4156-91d5-520bf2425f96-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Flow 'volume_create_manager' (e03bfa43-ce94-428e-81b8-22b872e72582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa56d5c1-0574-4783-b832-34ca5cc4b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa56d5c1-0574-4783-b832-34ca5cc4b522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-415565385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afa3a32-b197-4295-895f-9930977e80fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d19c62d81d4f0a8f6d6dc79b17560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:19Z,use_quota=True,user_id='9756b7db756643a993a96468e5aebc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a4ec11f-e4ee-457e-a598-6629d4227549),volume_type_id=4a4ec11f-e4ee-457e-a598-6629d4227549)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ea324a-955d-4197-932d-15096cbcd2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ea324a-955d-4197-932d-15096cbcd2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a3267e-eef8-4083-9121-c7bac1094b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a3267e-eef8-4083-9121-c7bac1094b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0afa3a32-b197-4295-895f-9930977e80fb', 'volume_name': 'volume-0afa3a32-b197-4295-895f-9930977e80fb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693ff1ce-53db-4122-8b7b-fe5686a877b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693ff1ce-53db-4122-8b7b-fe5686a877b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5105cb97-e64c-4f13-a6cc-1e1ba366bceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume 0afa3a32-b197-4295-895f-9930977e80fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0afa3a32-b197-4295-895f-9930977e80fb', 'volume_size': 1}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-415565385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afa3a32-b197-4295-895f-9930977e80fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d19c62d81d4f0a8f6d6dc79b17560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:19Z,use_quota=True,user_id='9756b7db756643a993a96468e5aebc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a4ec11f-e4ee-457e-a598-6629d4227549),volume_type_id=4a4ec11f-e4ee-457e-a598-6629d4227549)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Creating volume 0afa3a32-b197-4295-895f-9930977e80fb {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:18 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "cinder-551cc9df-a53b-4eb1-bb75-af3a56b46f16-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:18 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb 1073741824
Jul 31 14:58:18 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1af0ed45-186e-43c4-be4a-c7746ec5bb7f tempest-GroupSnapshotsTest-956376216 None] Update group completed successfully.
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-551cc9df-a53b-4eb1-bb75-af3a56b46f16-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "cinder-quobyte-551cc9df-a53b-4eb1-bb75-af3a56b46f16" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-quobyte-551cc9df-a53b-4eb1-bb75-af3a56b46f16" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911f739-5993-4fba-b13d-494805f3e1b6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:19 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16
Jul 31 14:58:19 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Flow 'volume_create_manager' (851833d6-aaba-480d-b0b8-57d695013cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f6ffb1-770b-49d6-aebc-ee7a320ace7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f6ffb1-770b-49d6-aebc-ee7a320ace7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1534642379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a042aa8a-6bbe-469d-bd75-898e0dd57161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d19c62d81d4f0a8f6d6dc79b17560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:19Z,use_quota=True,user_id='9756b7db756643a993a96468e5aebc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04dc618b-d5c8-4ef6-89ec-e9a68e5cbc95),volume_type_id=04dc618b-d5c8-4ef6-89ec-e9a68e5cbc95)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af66ec1a-868e-4d1c-a333-039aace5e7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af66ec1a-868e-4d1c-a333-039aace5e7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4732aa09-04df-477c-9bae-2c65311a19a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4732aa09-04df-477c-9bae-2c65311a19a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a042aa8a-6bbe-469d-bd75-898e0dd57161', 'volume_name': 'volume-a042aa8a-6bbe-469d-bd75-898e0dd57161', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82688765-804b-491b-8156-79b1f473d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82688765-804b-491b-8156-79b1f473d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff2c23e-c64e-4ff9-a955-518bc6396f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:19 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume a042aa8a-6bbe-469d-bd75-898e0dd57161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a042aa8a-6bbe-469d-bd75-898e0dd57161', 'volume_size': 1}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:19 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16" returned: 0 in 0.457s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:19 devstack sudo[100326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16
Jul 31 14:58:19 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:19 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb 1073741824" returned: 0 in 0.739s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:19 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb
Jul 31 14:58:19 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:19 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-551cc9df-a53b-4eb1-bb75-af3a56b46f16" returned: 0 in 0.323s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-quobyte-551cc9df-a53b-4eb1-bb75-af3a56b46f16" released by "delete_volume" :: held 0.904s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3ea55b77-0cf9-4c04-ad35-d63b3a50e210 tempest-GroupSnapshotsTest-956376216 None] Update group completed successfully.
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Created reservations ['43959619-cf8e-48ba-9a62-b4ece27f6ca5', 'd9046fc7-42c5-425c-94ab-4c38f6770adc', '6b7e7270-2a3c-4d26-8144-a50b6fe99ac3', '2098de9c-b115-4bc3-b054-6a8d6f3e4a7c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:20 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Flow 'volume_create_manager' (a8503263-9e63-455f-b48d-a38bf1ff9cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d095efc1-ecc4-4c4e-9fb4-2f382f66ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb" returned: 0 in 0.455s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1534642379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a042aa8a-6bbe-469d-bd75-898e0dd57161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d19c62d81d4f0a8f6d6dc79b17560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:19Z,use_quota=True,user_id='9756b7db756643a993a96468e5aebc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04dc618b-d5c8-4ef6-89ec-e9a68e5cbc95),volume_type_id=04dc618b-d5c8-4ef6-89ec-e9a68e5cbc95)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Creating volume a042aa8a-6bbe-469d-bd75-898e0dd57161 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:20 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d095efc1-ecc4-4c4e-9fb4-2f382f66ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246823955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ac8203-f5ef-4249-965a-e3f3f982bb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d19c62d81d4f0a8f6d6dc79b17560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:20Z,use_quota=True,user_id='9756b7db756643a993a96468e5aebc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5347a82-7c5a-446b-9e76-b3f8a16fb049),volume_type_id=d5347a82-7c5a-446b-9e76-b3f8a16fb049)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:20 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161 1073741824
Jul 31 14:58:20 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef89ecc-8d48-4bcd-9d35-dce995515d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef89ecc-8d48-4bcd-9d35-dce995515d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5a99dc-63b6-49a9-b902-da756b5750de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5105cb97-e64c-4f13-a6cc-1e1ba366bceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0afa3a32-b197-4295-895f-9930977e80fb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4850cd2a-20a8-4d95-958f-a0444367cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:20 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume volume-0afa3a32-b197-4295-895f-9930977e80fb (0afa3a32-b197-4295-895f-9930977e80fb): created successfully
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4850cd2a-20a8-4d95-958f-a0444367cc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Flow 'volume_create_manager' (e03bfa43-ce94-428e-81b8-22b872e72582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4926d553-75de-48ad-8561-e4b1bfb7e23b tempest-TestInstancesWithCinderVolumes-1648250274 None] Created volume successfully.
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:20 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:20 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:20 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Deleted volume successfully.
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-158c12d7-d463-4156-8178-fab0deb6395b tempest-VolumeSnapshotQuotasNegativeTestJSON-914167510 None] Lock "cinder-551cc9df-a53b-4eb1-bb75-af3a56b46f16-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:20 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5a99dc-63b6-49a9-b902-da756b5750de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9ac8203-f5ef-4249-965a-e3f3f982bb56', 'volume_name': 'volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56', 'volume_size': 1, 'image_id': '8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--908992864', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d19c62d81d4f0a8f6d6dc79b17560d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'created_at': datetime.datetime(2026, 7, 31, 12, 58, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 58, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda602930>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75c8c10-99c0-4810-b0bc-a26ec37ca924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75c8c10-99c0-4810-b0bc-a26ec37ca924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b05b65c-9cdd-4d67-9bcb-c938f1365c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:20 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume b9ac8203-f5ef-4249-965a-e3f3f982bb56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56', 'volume_size': 1, 'image_id': '8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--908992864', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d19c62d81d4f0a8f6d6dc79b17560d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'created_at': datetime.datetime(2026, 7, 31, 12, 58, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 58, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda602930>}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Trying to clone b9ac8203-f5ef-4249-965a-e3f3f982bb56 from image 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161 1073741824" returned: 0 in 0.635s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:20 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161
Jul 31 14:58:20 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:21 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161" returned: 0 in 0.334s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff2c23e-c64e-4ff9-a955-518bc6396f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a042aa8a-6bbe-469d-bd75-898e0dd57161', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912d7e99-ae3d-41af-ac3c-269b4a0c9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:21 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume volume-a042aa8a-6bbe-469d-bd75-898e0dd57161 (a042aa8a-6bbe-469d-bd75-898e0dd57161): created successfully
Jul 31 14:58:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912d7e99-ae3d-41af-ac3c-269b4a0c9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Flow 'volume_create_manager' (851833d6-aaba-480d-b0b8-57d695013cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8ee27320-b610-4831-ae79-d969bdeb86e1 tempest-TestInstancesWithCinderVolumes-1648250274 None] Created volume successfully.
Jul 31 14:58:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e4cd1449-7764-46e1-9bfe-fa974487678a tempest-GroupSnapshotsTest-956376216 None] Update group completed successfully.
Jul 31 14:58:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] GroupSnapshot bf1578dc-589b-4c10-a678-f59bc2b358b1: creating.
Jul 31 14:58:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Group snapshot bf1578dc-589b-4c10-a678-f59bc2b358b1: creating. {{(pid=88594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 31 14:58:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Creating offline snapshot 65485434-ad60-43c7-bd66-c800e05cd759 of volume d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:58:23 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a30fa-1b4d-4b14-bc82-31ce281841f4]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:23 devstack sudo[100346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4
Jul 31 14:58:23 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:23 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4" returned: 0 in 0.576s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:23 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 1G
Jul 31 14:58:23 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:24 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 1G" returned: 0 in 0.547s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:24 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759
Jul 31 14:58:24 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:24 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:24 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:24 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759
Jul 31 14:58:24 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:24 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759" returned: 0 in 0.306s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD, size 20.69 MB, duration 4.15 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 14:58:24 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Image download 20.69 MB at 4.98 MB/s
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4030b0-6d79-430f-8445-b79f5721a8d7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:24 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.info
Jul 31 14:58:24 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:25 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD
Jul 31 14:58:25 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:25 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.info" returned: 0 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:25 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:25 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.info
Jul 31 14:58:25 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:25 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Temporary image 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 is fetched for user 9756b7db756643a993a96468e5aebc3f. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca698168-b056-4202-a5e3-e8e788e3f664]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:25 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.info" returned: 0 in 0.326s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.705s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Creating offline snapshot b972cade-c123-439c-9ae6-67f146cae4de of volume 4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:58:25 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD
Jul 31 14:58:25 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d193355f-a4b3-46b6-9a7a-829db5393784]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:25 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d
Jul 31 14:58:25 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:25 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:26 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d" returned: 0 in 0.454s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:26 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de 1G
Jul 31 14:58:26 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:26 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de 1G" returned: 0 in 0.466s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4203ee78-0367-4bec-924d-f75acddd606d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:26 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4203ee78-0367-4bec-924d-f75acddd606d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de
Jul 31 14:58:26 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:26 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4203ee78-0367-4bec-924d-f75acddd606d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de" returned: 0 in 0.345s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:26 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:58:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:27 devstack sudo[100407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de
Jul 31 14:58:27 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:27 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de" returned: 0 in 0.293s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:27 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.info
Jul 31 14:58:27 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:27 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.info" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:27 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:27 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.info
Jul 31 14:58:27 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:27 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.info" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246823955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ac8203-f5ef-4249-965a-e3f3f982bb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d19c62d81d4f0a8f6d6dc79b17560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:20Z,use_quota=True,user_id='9756b7db756643a993a96468e5aebc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5347a82-7c5a-446b-9e76-b3f8a16fb049),volume_type_id=d5347a82-7c5a-446b-9e76-b3f8a16fb049)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Creating volume b9ac8203-f5ef-4249-965a-e3f3f982bb56 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:27 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:27 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 1073741824
Jul 31 14:58:27 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a0bfb358-5220-4068-b301-337119d80025 tempest-GroupSnapshotsTest-956376216 None] group_snapshot bf1578dc-589b-4c10-a678-f59bc2b358b1: created successfully
Jul 31 14:58:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] group_snapshot bf1578dc-589b-4c10-a678-f59bc2b358b1: deleting
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] group_snapshot bf1578dc-589b-4c10-a678-f59bc2b358b1: deleting {{(pid=88594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-d074f3cd-a902-4e02-b411-a785dbd3e0c4" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-d074f3cd-a902-4e02-b411-a785dbd3e0c4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-65485434-ad60-43c7-bd66-c800e05cd759" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-65485434-ad60-43c7-bd66-c800e05cd759" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Deleting offline snapshot 65485434-ad60-43c7-bd66-c800e05cd759 of volume d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] snapshot_file for this snap is: volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00265d4-b4dc-4b23-b08e-bc002b3004cb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:28 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 1073741824" returned: 0 in 0.680s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:28 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56
Jul 31 14:58:28 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:28 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759
Jul 31 14:58:28 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:29 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56" returned: 0 in 0.295s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Attempting download of 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'metadata': {}}])) to volume b9ac8203-f5ef-4249-965a-e3f3f982bb56. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acc031f-efde-4a19-8b2e-c599d2ceb9ae]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_jl0goel3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:29 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759" returned: 0 in 0.601s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89f272d-8b9f-44a1-87ea-78dac8a5b4bb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:29 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_jl0goel3
Jul 31 14:58:29 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:29 devstack sudo[100431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4
Jul 31 14:58:29 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:29 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_jl0goel3" returned: 0 in 0.424s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_jl0goel3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:29 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4" returned: 0 in 0.466s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:29 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_jl0goel3
Jul 31 14:58:29 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:29 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759
Jul 31 14:58:29 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Flow 'volume_create_manager' (b16b7b34-9b9f-4945-9c40-e1c5f70ef01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152da652-353d-4f1e-bb05-545ee450ed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152da652-353d-4f1e-bb05-545ee450ed7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1613100949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c498c2-0c2c-43a3-ad2a-caa43df5f76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101da6bfc2f84e3d8e1ed96c66f5effc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:30Z,use_quota=True,user_id='bdf5d3d6efa54fd1ab40c63ca9a4afae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd6cb95-e5ca-476d-9702-8ba1e13c0e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd6cb95-e5ca-476d-9702-8ba1e13c0e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28dac33-373c-460d-938f-c92809198a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28dac33-373c-460d-938f-c92809198a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c498c2-0c2c-43a3-ad2a-caa43df5f76c', 'volume_name': 'volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0586972-b195-4840-99e1-7f1782330b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0586972-b195-4840-99e1-7f1782330b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61e5077-8c1d-4f73-a6ee-3462bb0f0f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Volume e4c498c2-0c2c-43a3-ad2a-caa43df5f76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c', 'volume_size': 1}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1613100949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c498c2-0c2c-43a3-ad2a-caa43df5f76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101da6bfc2f84e3d8e1ed96c66f5effc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:30Z,use_quota=True,user_id='bdf5d3d6efa54fd1ab40c63ca9a4afae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Creating volume e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:29 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:29 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c 1073741824
Jul 31 14:58:29 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:29 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_jl0goel3" returned: 1 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_jl0goel3' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d1d941-4453-4d6d-984b-0ce516443db9]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:30 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD
Jul 31 14:58:30 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:30 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:30 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759
Jul 31 14:58:30 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:30 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c 1073741824" returned: 0 in 0.512s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:30 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 was qcow2, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:30 devstack sudo[100463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56
Jul 31 14:58:30 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:30 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4.65485434-ad60-43c7-bd66-c800e05cd759" returned: 0 in 0.316s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:30 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c
Jul 31 14:58:30 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-65485434-ad60-43c7-bd66-c800e05cd759" released by "_delete_snapshot" :: held 1.971s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-d074f3cd-a902-4e02-b411-a785dbd3e0c4" released by "delete_snapshot" :: held 2.014s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-4203ee78-0367-4bec-924d-f75acddd606d" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4203ee78-0367-4bec-924d-f75acddd606d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-b972cade-c123-439c-9ae6-67f146cae4de" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-b972cade-c123-439c-9ae6-67f146cae4de" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Deleting offline snapshot b972cade-c123-439c-9ae6-67f146cae4de of volume 4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] snapshot_file for this snap is: volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc436ac5-f6ff-4d0a-80c6-08f6a20a1998]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:30 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61e5077-8c1d-4f73-a6ee-3462bb0f0f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac9e132-6307-4453-a7f6-7b22a4dc7a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:30 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de
Jul 31 14:58:30 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Volume volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c (e4c498c2-0c2c-43a3-ad2a-caa43df5f76c): created successfully
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac9e132-6307-4453-a7f6-7b22a4dc7a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Flow 'volume_create_manager' (b16b7b34-9b9f-4945-9c40-e1c5f70ef01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9c88001a-c0a0-4c3c-a7ba-6f2c7ad14dc1 tempest-SnapshotMetadataTestJSON-100790313 None] Created volume successfully.
Jul 31 14:58:31 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de" returned: 0 in 0.450s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4203ee78-0367-4bec-924d-f75acddd606d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a3a43c-576b-41ab-9dd1-2fa884d5853f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:31 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d
Jul 31 14:58:31 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:31 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d" returned: 0 in 0.504s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:31 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de
Jul 31 14:58:31 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:32 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de" returned: 0 in 0.510s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Creating offline snapshot 84dd5fb1-869f-414a-ae2c-cabe6fa49c0e of volume e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:58:32 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de
Jul 31 14:58:32 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e821cc8-a6c9-4b23-8fb3-e1259022ef59]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:32 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c
Jul 31 14:58:32 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:32 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d.b972cade-c123-439c-9ae6-67f146cae4de" returned: 0 in 0.265s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-b972cade-c123-439c-9ae6-67f146cae4de" released by "_delete_snapshot" :: held 1.859s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4203ee78-0367-4bec-924d-f75acddd606d" released by "delete_snapshot" :: held 1.890s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:32 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56" returned: 0 in 2.088s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1_7fnfqwtkdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:58:32 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Converted 112.00 MB image at 53.63 MB/s
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:32 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 1G
Jul 31 14:58:32 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:32 devstack cinder-volume[88594]: WARNING cinder.quota [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-36984107 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-36984107, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:32 devstack cinder-volume[88594]: WARNING cinder.quota [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-36984107 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-36984107, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['287e5836-5b08-4724-becd-6734503446cc', 'fdc01447-86e0-4adf-b5b7-d5178f901df4', 'd30269cd-3230-4fa3-a837-a6c08149655e', 'faac29d3-cbe4-4fcd-89b8-ea5ed44590b5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:32 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" returned: 0 in 0.510s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:32 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e 1G
Jul 31 14:58:32 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:32 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['6dc4dbd9-3207-4666-aa06-51d11bac6507', '0cc0285e-7ed2-4151-9f07-291f72f2c469', '7cd6d8ce-fc05-47c0-8b40-58e04eb00915', '882989d0-97bc-45c3-a1e1-42a2f6d59c72'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d650f9c0-feb4-4e88-b741-97b53e636e67 tempest-GroupSnapshotsTest-956376216 None] group_snapshot bf1578dc-589b-4c10-a678-f59bc2b358b1: deleted successfully
Jul 31 14:58:33 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 1G" returned: 0 in 0.593s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Downloaded image 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'metadata': {}}])) to volume b9ac8203-f5ef-4249-965a-e3f3f982bb56 successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Temporary image 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 for user 9756b7db756643a993a96468e5aebc3f is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Marking volume b9ac8203-f5ef-4249-965a-e3f3f982bb56 as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Copying metadata from image 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 to b9ac8203-f5ef-4249-965a-e3f3f982bb56. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Creating volume glance metadata for volume b9ac8203-f5ef-4249-965a-e3f3f982bb56 backed by image 8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1 with: {'image_id': '8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'image_name': 'tempest-scenario-img--908992864', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b05b65c-9cdd-4d67-9bcb-c938f1365c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56', 'volume_size': 1, 'image_id': '8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--908992864', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d19c62d81d4f0a8f6d6dc79b17560d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1', 'created_at': datetime.datetime(2026, 7, 31, 12, 58, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 58, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ccba0d9-6a39-46db-b2d7-0b5e1a095cc1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda602930>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a718e14-149a-412f-926d-267a1e9d9128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:33 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Volume volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 (b9ac8203-f5ef-4249-965a-e3f3f982bb56): created successfully
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a718e14-149a-412f-926d-267a1e9d9128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Flow 'volume_create_manager' (a8503263-9e63-455f-b48d-a38bf1ff9cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b3e00564-5c07-421f-a223-7400572b11c5 tempest-TestInstancesWithCinderVolumes-1648250274 None] Created volume successfully.
Jul 31 14:58:33 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e 1G" returned: 0 in 0.709s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:33 devstack sudo[100511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e
Jul 31 14:58:33 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:33 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-4203ee78-0367-4bec-924d-f75acddd606d" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" returned: 0 in 0.332s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:33 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e is being set with open permissions: ugo+rw
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4203ee78-0367-4bec-924d-f75acddd606d" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:33 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e
Jul 31 14:58:33 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f560a7e1-8a93-43b0-8c8f-ddf9047ce108]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:33 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d
Jul 31 14:58:33 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:33 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:34 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.info
Jul 31 14:58:34 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:34 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d" returned: 0 in 0.450s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:34 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d
Jul 31 14:58:34 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:34 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.info" returned: 0 in 0.370s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:34 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.info is being set with open permissions: ugo+rw
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:34 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.info
Jul 31 14:58:34 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:34 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4203ee78-0367-4bec-924d-f75acddd606d" returned: 0 in 0.320s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-4203ee78-0367-4bec-924d-f75acddd606d" released by "delete_volume" :: held 0.876s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-d074f3cd-a902-4e02-b411-a785dbd3e0c4" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-d074f3cd-a902-4e02-b411-a785dbd3e0c4" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ebc3f5-cc4f-4d2b-a1ef-9b3174fe2d62]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:34 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.info" returned: 0 in 0.329s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-abae55b1-b1c7-4850-a2b6-02522e173bb8 tempest-SnapshotMetadataTestJSON-100790313 None] Create snapshot completed successfully
Jul 31 14:58:34 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4
Jul 31 14:58:34 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:35 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4" returned: 0 in 0.477s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:35 devstack sudo[100539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4
Jul 31 14:58:35 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:35 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d074f3cd-a902-4e02-b411-a785dbd3e0c4" returned: 0 in 0.453s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-d074f3cd-a902-4e02-b411-a785dbd3e0c4" released by "delete_volume" :: held 1.028s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['e3fd4e61-3cb4-446e-b1f7-6354c019ff08'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:35 devstack cinder-volume[88594]: WARNING cinder.quota [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-36984107 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-36984107, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['539bf35d-407d-4455-8750-2ab015bcaf1a', '58ab95b3-7078-4ea0-9940-778fda7ffe75', 'a34a9706-30fd-408f-b7e9-45fc6256046c', 'eb1d4ef3-f9fc-44ac-8744-a05b0681255b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['cd844954-1963-45ca-a281-1beca9a82c3b', 'e5421c66-ea9e-403a-8440-cf5a1cdee2f8', 'dfa065d5-c63e-455d-af2d-0ca261749f1e', '6777f9d2-cea7-4669-9af6-9501d810e698'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "cinder-84dd5fb1-869f-414a-ae2c-cabe6fa49c0e-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-84dd5fb1-869f-414a-ae2c-cabe6fa49c0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "cinder-quobyte-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:36 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:36 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-quobyte-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "cinder-quobyte-84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-quobyte-84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Deleting offline snapshot 84dd5fb1-869f-414a-ae2c-cabe6fa49c0e of volume e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] snapshot_file for this snap is: volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d3ef5-509d-481d-94d2-694b381b3d39]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:36 devstack sudo[100547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e
Jul 31 14:58:36 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:36 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.374s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1a0c6517-35eb-4be2-95c2-dce170b58a16 tempest-GroupSnapshotsTest-956376216 None] Delete group completed successfully.
Jul 31 14:58:36 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" returned: 0 in 0.466s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac775125-2454-456b-b255-86e806cadc90]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:37 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c
Jul 31 14:58:37 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:37 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" returned: 0 in 0.622s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:37 devstack sudo[100560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e
Jul 31 14:58:37 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ebb62575-46c3-458b-acf9-7caef1d1bf6f req-74770ed1-9eff-4fd4-88ad-08789cca34b8 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ebb62575-46c3-458b-acf9-7caef1d1bf6f req-74770ed1-9eff-4fd4-88ad-08789cca34b8 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-ebb62575-46c3-458b-acf9-7caef1d1bf6f req-74770ed1-9eff-4fd4-88ad-08789cca34b8 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-ebb62575-46c3-458b-acf9-7caef1d1bf6f req-74770ed1-9eff-4fd4-88ad-08789cca34b8 tempest-TestInstancesWithCinderVolumes-1648250274 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8403fdb3-c5ad-4656-83a7-725443427271', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:58:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-ebb62575-46c3-458b-acf9-7caef1d1bf6f req-74770ed1-9eff-4fd4-88ad-08789cca34b8 tempest-TestInstancesWithCinderVolumes-1648250274 None] attachment_update completed successfully.
Jul 31 14:58:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-27e5b753-b582-4f63-8888-b4671ba94034 tempest-GroupSnapshotsTest-956376216 None] Group tempest-GroupSnapshotsTest-Group-1168342163: creating
Jul 31 14:58:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-27e5b753-b582-4f63-8888-b4671ba94034 tempest-GroupSnapshotsTest-956376216 None] Group tempest-GroupSnapshotsTest-Group-1168342163: created successfully
Jul 31 14:58:38 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" returned: 0 in 0.641s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-27e5b753-b582-4f63-8888-b4671ba94034 tempest-GroupSnapshotsTest-956376216 None] Create group completed successfully.
Jul 31 14:58:38 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e
Jul 31 14:58:38 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:38 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c.84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" returned: 0 in 0.372s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-quobyte-84dd5fb1-869f-414a-ae2c-cabe6fa49c0e" released by "_delete_snapshot" :: held 2.278s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-quobyte-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" released by "delete_snapshot" :: held 2.313s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Created reservations ['f1f12631-092b-451b-b788-9f2789e0f3ce', 'f5a26bad-6354-4ba8-a70a-75be87988d8b', '3d3c92bb-0f81-4fe7-963c-299f515b4566', '97066cc1-74b0-4fdc-9c96-dacc9ba18ee7'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Delete snapshot completed successfully.
Jul 31 14:58:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d030f13-c131-4cf6-a446-73aed893bbd8 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-84dd5fb1-869f-414a-ae2c-cabe6fa49c0e-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "cinder-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "cinder-quobyte-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-quobyte-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff3d18-cc37-4a09-917e-d5f58af64dfa]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:40 devstack sudo[100578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c
Jul 31 14:58:40 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (257d6811-5e5b-4962-b7cb-94b6cf99ebc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419ad078-25ba-4265-8b6c-000b3484c271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419ad078-25ba-4265-8b6c-000b3484c271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681296245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b24e76cf-19ef-45f6-a0b6-06261ef5e010,host='devstack@QuobyteHD#QuobyteHD',id=c2436365-1b39-4f88-a4d0-2ccf06494853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:40Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9378ff05-76d2-4de5-a5bf-5bf630951c2d),volume_type_id=9378ff05-76d2-4de5-a5bf-5bf630951c2d)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c848105-7b14-4607-a85d-4ab6dc904b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c848105-7b14-4607-a85d-4ab6dc904b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37560f8-2221-405f-96f3-47a81f44b42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37560f8-2221-405f-96f3-47a81f44b42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2436365-1b39-4f88-a4d0-2ccf06494853', 'volume_name': 'volume-c2436365-1b39-4f88-a4d0-2ccf06494853', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4894d6-823a-4878-bf72-6995cb1b1428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4894d6-823a-4878-bf72-6995cb1b1428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fcf248-80a2-417f-8ef2-3b69d61e5e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Volume c2436365-1b39-4f88-a4d0-2ccf06494853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2436365-1b39-4f88-a4d0-2ccf06494853', 'volume_size': 1}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b24e76cf-19ef-45f6-a0b6-06261ef5e010,created_at=2026-07-31T12:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681296245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b24e76cf-19ef-45f6-a0b6-06261ef5e010,host='devstack@QuobyteHD#QuobyteHD',id=c2436365-1b39-4f88-a4d0-2ccf06494853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439f61c01601403f8b0c43f6210db782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:40Z,use_quota=True,user_id='200c9161764a4839ae0cf393be173b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9378ff05-76d2-4de5-a5bf-5bf630951c2d),volume_type_id=9378ff05-76d2-4de5-a5bf-5bf630951c2d)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Creating volume c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:40 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:40 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 1073741824
Jul 31 14:58:40 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:40 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" returned: 0 in 0.618s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:40 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c
Jul 31 14:58:40 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:40 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" returned: 0 in 0.393s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-quobyte-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c" released by "delete_volume" :: held 1.108s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Created reservations ['789d4acf-af9c-4631-99c6-85560155c27a', '08c716cd-b8cf-4c85-8b59-7e98230391ee', '544f2e14-d153-4da2-bffe-2ce5f310da78', '809bf791-7b77-4cd7-a28c-419af52ec962'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:41 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 1073741824" returned: 0 in 0.659s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:41 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853
Jul 31 14:58:41 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:41 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:41 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:41 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.356s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Deleted volume successfully.
Jul 31 14:58:41 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853" returned: 0 in 0.449s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8e07f1dd-cd18-47a1-8dca-f9275d3026e5 tempest-SnapshotMetadataTestJSON-100790313 None] Lock "cinder-e4c498c2-0c2c-43a3-ad2a-caa43df5f76c-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fcf248-80a2-417f-8ef2-3b69d61e5e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2436365-1b39-4f88-a4d0-2ccf06494853', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51315cc8-a5af-4e95-a108-9563fb170f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:41 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Volume volume-c2436365-1b39-4f88-a4d0-2ccf06494853 (c2436365-1b39-4f88-a4d0-2ccf06494853): created successfully
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51315cc8-a5af-4e95-a108-9563fb170f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Flow 'volume_create_manager' (257d6811-5e5b-4962-b7cb-94b6cf99ebc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3b975010-609c-4730-b416-001296a22892 tempest-GroupSnapshotsTest-956376216 None] Created volume successfully.
Jul 31 14:58:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] GroupSnapshot 0b65f350-79c2-4b14-9fee-76a817eea728: creating.
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Group snapshot 0b65f350-79c2-4b14-9fee-76a817eea728: creating. {{(pid=88594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Creating offline snapshot 62e1bdc5-204f-4fef-805c-93fd7cda569c of volume c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f8b13e-a207-4ece-b4c3-c58463ed53ef]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:43 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853
Jul 31 14:58:43 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:43 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853" returned: 0 in 0.558s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:43 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c 1G
Jul 31 14:58:43 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:44 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c 1G" returned: 0 in 0.748s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2436365-1b39-4f88-a4d0-2ccf06494853 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:44 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2436365-1b39-4f88-a4d0-2ccf06494853 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c
Jul 31 14:58:44 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:45 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2436365-1b39-4f88-a4d0-2ccf06494853 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c" returned: 0 in 0.429s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:45 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:58:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:45 devstack sudo[101072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c
Jul 31 14:58:45 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:45 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c" returned: 0 in 0.405s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:45 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.info
Jul 31 14:58:45 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:45 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.info" returned: 0 in 0.460s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:45 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:58:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:46 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.info
Jul 31 14:58:46 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:46 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.info" returned: 0 in 0.531s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.334s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:46 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bf68be3f-56bd-4119-a7e5-29386dd6315b tempest-GroupSnapshotsTest-956376216 None] group_snapshot 0b65f350-79c2-4b14-9fee-76a817eea728: created successfully
Jul 31 14:58:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] group_snapshot 0b65f350-79c2-4b14-9fee-76a817eea728: deleting
Jul 31 14:58:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] group_snapshot 0b65f350-79c2-4b14-9fee-76a817eea728: deleting {{(pid=88594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-c2436365-1b39-4f88-a4d0-2ccf06494853" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-c2436365-1b39-4f88-a4d0-2ccf06494853" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-62e1bdc5-204f-4fef-805c-93fd7cda569c" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-62e1bdc5-204f-4fef-805c-93fd7cda569c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Deleting offline snapshot 62e1bdc5-204f-4fef-805c-93fd7cda569c of volume c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] snapshot_file for this snap is: volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c802281a-40d1-4104-9995-9aa59dfa3380]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:48 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c
Jul 31 14:58:48 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:48 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c" returned: 0 in 0.550s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2436365-1b39-4f88-a4d0-2ccf06494853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd42eb9-dd0e-4ea2-bce4-29fca74088cc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:48 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853
Jul 31 14:58:48 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:49 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853" returned: 0 in 0.583s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:49 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c
Jul 31 14:58:49 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=166,cinder:DELETE=9,cinder:SELECT=182,cinder:INSERT=46 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=155,cinder:INSERT=44,cinder:UPDATE=172,cinder:DELETE=10 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:58:49 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Flow 'volume_create_manager' (41018355-c56d-4646-ab77-632d93d03dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1bd72a-5940-48a0-9563-2a4459c6b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c" returned: 0 in 0.671s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1bd72a-5940-48a0-9563-2a4459c6b690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-465885495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fe1e46-7e32-4f40-8215-0d4291a668f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa247786067a4edca4e8e1cfec9b4151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:50Z,use_quota=True,user_id='4fafa8a7c55744c3a0657516938a8ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fb5058-6a3b-4c09-aaae-be19fe54b076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fb5058-6a3b-4c09-aaae-be19fe54b076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:50 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c
Jul 31 14:58:50 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4bc8a6-d1c9-4df2-b36c-ecee8e0c0e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4bc8a6-d1c9-4df2-b36c-ecee8e0c0e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62fe1e46-7e32-4f40-8215-0d4291a668f5', 'volume_name': 'volume-62fe1e46-7e32-4f40-8215-0d4291a668f5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a558d2ca-5152-4fcf-b035-03613ad2422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a558d2ca-5152-4fcf-b035-03613ad2422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5d556-e371-4d1a-8490-87a29c8c0822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:50 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Volume 62fe1e46-7e32-4f40-8215-0d4291a668f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62fe1e46-7e32-4f40-8215-0d4291a668f5', 'volume_size': 1}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-465885495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fe1e46-7e32-4f40-8215-0d4291a668f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa247786067a4edca4e8e1cfec9b4151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:50Z,use_quota=True,user_id='4fafa8a7c55744c3a0657516938a8ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Creating volume 62fe1e46-7e32-4f40-8215-0d4291a668f5 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:50 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:50 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5 1073741824
Jul 31 14:58:50 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:50 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853.62e1bdc5-204f-4fef-805c-93fd7cda569c" returned: 0 in 0.519s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-62e1bdc5-204f-4fef-805c-93fd7cda569c" released by "_delete_snapshot" :: held 2.492s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-c2436365-1b39-4f88-a4d0-2ccf06494853" released by "delete_snapshot" :: held 2.534s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:50 devstack cinder-volume[88594]: WARNING cinder.quota [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1071145460 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1071145460, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:50 devstack cinder-volume[88594]: WARNING cinder.quota [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1071145460 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1071145460, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] Created reservations ['73022c69-94a6-4767-a2e2-4019eb334c37', '1077f785-97b2-4378-84d2-6802b8d9b287', '66e4679c-1948-44fc-97ea-88e4cca5cefe', 'b6d92236-eaae-4694-a587-032b489e990e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7853069a-ff87-4def-9a0a-6403d97e8a52 tempest-GroupSnapshotsTest-956376216 None] group_snapshot 0b65f350-79c2-4b14-9fee-76a817eea728: deleted successfully
Jul 31 14:58:51 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5 1073741824" returned: 0 in 1.073s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:51 devstack sudo[101119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5
Jul 31 14:58:51 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:51 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5" returned: 0 in 0.503s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5d556-e371-4d1a-8490-87a29c8c0822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62fe1e46-7e32-4f40-8215-0d4291a668f5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2938b1-e8c5-479d-bedf-41a5c066ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:51 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Volume volume-62fe1e46-7e32-4f40-8215-0d4291a668f5 (62fe1e46-7e32-4f40-8215-0d4291a668f5): created successfully
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2938b1-e8c5-479d-bedf-41a5c066ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Flow 'volume_create_manager' (41018355-c56d-4646-ab77-632d93d03dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f9394e40-a569-4bf8-91b7-5d3896f15435 tempest-VolumesTransfersV355Test-404281234 None] Created volume successfully.
Jul 31 14:58:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "cinder-quobyte-c2436365-1b39-4f88-a4d0-2ccf06494853" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-c2436365-1b39-4f88-a4d0-2ccf06494853" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:52 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc54961-69d0-4976-a659-bab00e6e1077]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:52 devstack sudo[101123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853
Jul 31 14:58:52 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:53 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853" returned: 0 in 0.837s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:53 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853
Jul 31 14:58:53 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-773ba592-0e70-4071-93e5-ca2bf65ab994 tempest-VolumesTransfersV355Test-1804168606 None] Transfer volume completed successfully.
Jul 31 14:58:53 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c2436365-1b39-4f88-a4d0-2ccf06494853" returned: 0 in 0.418s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Lock "cinder-quobyte-c2436365-1b39-4f88-a4d0-2ccf06494853" released by "delete_volume" :: held 1.379s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:53 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Created reservations ['86db5a0d-2e4f-49e7-b0e8-bd73eb55f48a'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:53 devstack cinder-volume[88594]: WARNING cinder.quota [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1071145460 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1071145460, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:58:53 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Created reservations ['1a9354a3-7b42-4bf8-9e2e-510e0ad64866', '21018714-d850-4a94-9549-23bcfd3c66bb', '93fc232f-b927-487e-8224-cc04124a6015', '4aae4c9b-f3fc-4a64-8552-c386767a00c4'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:54 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:54 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Acquiring lock "cinder-62fe1e46-7e32-4f40-8215-0d4291a668f5-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-62fe1e46-7e32-4f40-8215-0d4291a668f5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Acquiring lock "cinder-quobyte-62fe1e46-7e32-4f40-8215-0d4291a668f5" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-quobyte-62fe1e46-7e32-4f40-8215-0d4291a668f5" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15eff85-dc9e-4b9c-8501-3fa2dd297461]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:54 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.593s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:54 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:54 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-03e03a91-2475-46bb-aedd-69cd3029a99a tempest-GroupSnapshotsTest-956376216 None] Delete group completed successfully.
Jul 31 14:58:54 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5
Jul 31 14:58:54 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:55 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5" returned: 0 in 0.678s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:55 devstack sudo[101140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5
Jul 31 14:58:55 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:55 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62fe1e46-7e32-4f40-8215-0d4291a668f5" returned: 0 in 0.541s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-quobyte-62fe1e46-7e32-4f40-8215-0d4291a668f5" released by "delete_volume" :: held 1.284s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:55 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Created reservations ['b70a53d1-2002-4e39-bce0-7306aa056f46', '2d26423b-4ab6-4ceb-9988-81cb1832756f', 'bcbdf695-d858-47bc-8350-c805aa7f3f8b', 'deea22ab-53bc-4d62-bf0a-e93e0c3c1865'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:56 devstack sudo[101143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:56 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:56 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.366s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:56 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Deleted volume successfully.
Jul 31 14:58:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3074b906-d4fd-40a8-8339-95638d32e58b tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-62fe1e46-7e32-4f40-8215-0d4291a668f5-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Flow 'volume_create_manager' (d07733c3-5e63-446b-ab1b-2d021aff0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a34e9d-f2ec-46ca-a035-de73688e032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a34e9d-f2ec-46ca-a035-de73688e032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-490906972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59544ac3-eeaf-4f5a-8400-56fc8b65c06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa247786067a4edca4e8e1cfec9b4151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:58Z,use_quota=True,user_id='4fafa8a7c55744c3a0657516938a8ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa59824d-95a8-46e8-a8ec-3433580d6bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa59824d-95a8-46e8-a8ec-3433580d6bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d245ff1a-8054-410a-8b38-b4b0d3bd386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d245ff1a-8054-410a-8b38-b4b0d3bd386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59544ac3-eeaf-4f5a-8400-56fc8b65c06c', 'volume_name': 'volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fcbca0-de99-413c-9dca-9f3e3e1a5ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fcbca0-de99-413c-9dca-9f3e3e1a5ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d818a005-f315-42b0-84bf-085bf6b569e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Volume 59544ac3-eeaf-4f5a-8400-56fc8b65c06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c', 'volume_size': 1}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-490906972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59544ac3-eeaf-4f5a-8400-56fc8b65c06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa247786067a4edca4e8e1cfec9b4151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:58:58Z,use_quota=True,user_id='4fafa8a7c55744c3a0657516938a8ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Creating volume 59544ac3-eeaf-4f5a-8400-56fc8b65c06c {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:58:57 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:57 devstack sudo[101146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c 1073741824
Jul 31 14:58:57 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:58 devstack sudo[101148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:58:58 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:58 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.566s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:58:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:58:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:58:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:58:58 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c 1073741824" returned: 0 in 0.951s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:58:58 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c
Jul 31 14:58:58 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:58:59 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Jul 31 14:58:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c" returned: 0 in 0.340s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:58:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:58:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:58:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d818a005-f315-42b0-84bf-085bf6b569e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb4f080-cde7-4fac-92b1-636746bad4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:58:59 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Volume volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c (59544ac3-eeaf-4f5a-8400-56fc8b65c06c): created successfully
Jul 31 14:58:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb4f080-cde7-4fac-92b1-636746bad4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:58:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Flow 'volume_create_manager' (d07733c3-5e63-446b-ab1b-2d021aff0267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:58:59 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-06c902c4-6202-4489-81b3-9478e8978c40 tempest-VolumesTransfersV355Test-404281234 None] Created volume successfully.
Jul 31 14:59:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Acquiring lock "cinder-59544ac3-eeaf-4f5a-8400-56fc8b65c06c-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-59544ac3-eeaf-4f5a-8400-56fc8b65c06c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Acquiring lock "cinder-quobyte-59544ac3-eeaf-4f5a-8400-56fc8b65c06c" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-quobyte-59544ac3-eeaf-4f5a-8400-56fc8b65c06c" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:00 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35353b1-c298-4778-88d3-3cb3204d59c9]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:00 devstack sudo[101159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c
Jul 31 14:59:00 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:01 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c" returned: 0 in 0.506s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:01 devstack sudo[101164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c
Jul 31 14:59:01 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Flow 'volume_create_manager' (e5065ec4-221f-4ed5-92ad-39a2d1b14537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1009b4-7a25-47f6-bd86-dedf48f3f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1009b4-7a25-47f6-bd86-dedf48f3f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1911484567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f113839b-3ac0-4abc-adcd-8c08e3ef40d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8474ac5b4e0f4f3a8dbcd997ae800f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:01Z,use_quota=True,user_id='24c350736403486489a0f88e0a84749b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1b322d-6232-4624-8f2d-c7c591b3af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1b322d-6232-4624-8f2d-c7c591b3af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba1622-ba7a-418d-b552-6cfe73007525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba1622-ba7a-418d-b552-6cfe73007525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f113839b-3ac0-4abc-adcd-8c08e3ef40d0', 'volume_name': 'volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7679762f-e87c-43c3-9355-890c8c2e1013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7679762f-e87c-43c3-9355-890c8c2e1013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedc5ba0-999f-4dc5-bb5a-4b059d1f8fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:01 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Volume f113839b-3ac0-4abc-adcd-8c08e3ef40d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0', 'volume_size': 1}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1911484567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f113839b-3ac0-4abc-adcd-8c08e3ef40d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8474ac5b4e0f4f3a8dbcd997ae800f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:01Z,use_quota=True,user_id='24c350736403486489a0f88e0a84749b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Creating volume f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:01 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:01 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-59544ac3-eeaf-4f5a-8400-56fc8b65c06c" returned: 0 in 0.471s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:01 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 1073741824
Jul 31 14:59:01 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-quobyte-59544ac3-eeaf-4f5a-8400-56fc8b65c06c" released by "delete_volume" :: held 1.054s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Created reservations ['6f8c31e2-f49e-4275-afb5-7764c3ffaf54', '7d301f8f-105a-4510-9279-172002e33e90', '0c5e96d0-981a-4cf6-8103-266e0aca1a25', 'd1ac499c-1323-40f7-a618-a360d006fa6e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:01 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:01 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:02 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.319s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:02 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Deleted volume successfully.
Jul 31 14:59:02 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 1073741824" returned: 0 in 0.569s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1debec84-723c-42c6-8874-22699a2ba2d0 tempest-VolumesTransfersV355Test-1914271388 None] Lock "cinder-59544ac3-eeaf-4f5a-8400-56fc8b65c06c-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:02 devstack sudo[101177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0
Jul 31 14:59:02 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:02 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" returned: 0 in 0.288s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedc5ba0-999f-4dc5-bb5a-4b059d1f8fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf2844f-0d50-4710-9cb6-d868ca93ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:02 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Volume volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 (f113839b-3ac0-4abc-adcd-8c08e3ef40d0): created successfully
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf2844f-0d50-4710-9cb6-d868ca93ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Flow 'volume_create_manager' (e5065ec4-221f-4ed5-92ad-39a2d1b14537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:02 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-36d178c2-37d7-4e3c-b056-4300a3547a13 tempest-SnapshotDependencyTests-2136909144 None] Created volume successfully.
Jul 31 14:59:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Creating offline snapshot 1ad12d92-7698-4de1-8f1c-01a0ebf86e2b of volume f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:59:03 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf1c5ef-b54e-4ca6-a556-5a9b4c5dadd3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:04 devstack sudo[101215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0
Jul 31 14:59:04 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d26789fd-3fcb-4121-98fd-d49856a270ee tempest-GroupSnapshotsV319Test-1618650514 None] Group tempest-GroupSnapshotsV319Test-Group-1233191090: creating
Jul 31 14:59:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d26789fd-3fcb-4121-98fd-d49856a270ee tempest-GroupSnapshotsV319Test-1618650514 None] Group tempest-GroupSnapshotsV319Test-Group-1233191090: created successfully
Jul 31 14:59:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d26789fd-3fcb-4121-98fd-d49856a270ee tempest-GroupSnapshotsV319Test-1618650514 None] Create group completed successfully.
Jul 31 14:59:04 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" returned: 0 in 0.476s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:04 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b 1G
Jul 31 14:59:04 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:04 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b 1G" returned: 0 in 0.429s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:04 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b
Jul 31 14:59:04 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:05 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" returned: 0 in 0.299s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:05 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b is being set with open permissions: ugo+rw
Jul 31 14:59:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:05 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b
Jul 31 14:59:05 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:05 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" returned: 0 in 0.323s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:05 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.info
Jul 31 14:59:05 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:05 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.info" returned: 0 in 0.374s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:05 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.info is being set with open permissions: ugo+rw
Jul 31 14:59:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:05 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.info
Jul 31 14:59:05 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Flow 'volume_create_manager' (33601034-928a-41ee-a0ec-aecb0c2a70b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e478b86d-095a-4893-854c-8072185beffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e478b86d-095a-4893-854c-8072185beffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665736260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6199bc54-bbe4-4a40-b21b-d4a6b8169aba,host='devstack@QuobyteHD#QuobyteHD',id=7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf01a3333c2433fafda42c70aa885dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:06Z,use_quota=True,user_id='321688cf856d4b1fa032575a437f65bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(454aed42-85a2-4474-8287-90cc77c24f83),volume_type_id=454aed42-85a2-4474-8287-90cc77c24f83)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c91290b-740a-4618-86a0-f77f3d45cadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c91290b-740a-4618-86a0-f77f3d45cadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ad570c-9153-49d8-b1df-863414fa5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ad570c-9153-49d8-b1df-863414fa5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f', 'volume_name': 'volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7629ea-b695-4ddc-8d26-b1dc4213f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7629ea-b695-4ddc-8d26-b1dc4213f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c850a342-812c-4288-b2b4-6e1bbc9b1af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:06 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Volume 7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f', 'volume_size': 1}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:06 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.info" returned: 0 in 0.379s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6199bc54-bbe4-4a40-b21b-d4a6b8169aba,created_at=2026-07-31T12:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665736260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6199bc54-bbe4-4a40-b21b-d4a6b8169aba,host='devstack@QuobyteHD#QuobyteHD',id=7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf01a3333c2433fafda42c70aa885dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:06Z,use_quota=True,user_id='321688cf856d4b1fa032575a437f65bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(454aed42-85a2-4474-8287-90cc77c24f83),volume_type_id=454aed42-85a2-4474-8287-90cc77c24f83)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Creating volume 7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:06 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:06 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f 1073741824
Jul 31 14:59:06 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6fdd288c-c2d0-40d8-946b-78ccd5cb20c3 tempest-SnapshotDependencyTests-2136909144 None] Create snapshot completed successfully
Jul 31 14:59:06 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f 1073741824" returned: 0 in 0.443s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:06 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f
Jul 31 14:59:06 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:07 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c850a342-812c-4288-b2b4-6e1bbc9b1af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5943e585-cade-4091-ba8f-c3fcc8de5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:07 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Volume volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f (7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f): created successfully
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5943e585-cade-4091-ba8f-c3fcc8de5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Flow 'volume_create_manager' (33601034-928a-41ee-a0ec-aecb0c2a70b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:07 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4511f44e-5e12-4976-8cd1-b3f3b1473af6 tempest-GroupSnapshotsV319Test-1618650514 None] Created volume successfully.
Jul 31 14:59:07 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] GroupSnapshot 961af6db-5a2e-48fd-8c57-553c6ede7ff2: creating.
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Group snapshot 961af6db-5a2e-48fd-8c57-553c6ede7ff2: creating. {{(pid=88594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Creating offline snapshot 5c022bf0-c528-4e3d-b902-dede9c62bc6f of volume 7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fd35cb-0312-408e-9752-f0a28b44557f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:07 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f
Jul 31 14:59:07 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Flow 'volume_create_manager' (46af2e46-9ae9-45ce-a381-fbeb03745285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312c94bd-dfaa-4469-9080-6ea7d0845595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312c94bd-dfaa-4469-9080-6ea7d0845595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14598e72-4fde-4aa2-a041-7d4da84bd7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8474ac5b4e0f4f3a8dbcd997ae800f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ad12d92-7698-4de1-8f1c-01a0ebf86e2b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:08Z,use_quota=True,user_id='24c350736403486489a0f88e0a84749b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10530a4-6952-4168-8faa-13eae9fcd1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10530a4-6952-4168-8faa-13eae9fcd1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7b1f2e-c85d-41aa-bf87-b010b6192835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7b1f2e-c85d-41aa-bf87-b010b6192835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14598e72-4fde-4aa2-a041-7d4da84bd7ca', 'volume_name': 'volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca', 'volume_size': 1, 'snapshot_id': '1ad12d92-7698-4de1-8f1c-01a0ebf86e2b'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa8b1fd-5658-4dd3-8dab-4a3666390007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa8b1fd-5658-4dd3-8dab-4a3666390007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0dcbf0d-dbcc-4c90-858c-412f93ac677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:07 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Volume 14598e72-4fde-4aa2-a041-7d4da84bd7ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca', 'volume_size': 1, 'snapshot_id': '1ad12d92-7698-4de1-8f1c-01a0ebf86e2b'}
Jul 31 14:59:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:08 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" returned: 0 in 0.386s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:08 devstack sudo[101256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f 1G
Jul 31 14:59:08 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:08 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f 1G" returned: 0 in 0.424s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:08 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f
Jul 31 14:59:08 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:08 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f" returned: 0 in 0.328s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:08 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:08 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f
Jul 31 14:59:08 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Flow 'volume_create_manager' (09284022-81cc-404f-81ec-2965f8cd5590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e261a113-db73-4d0b-b6a1-a1f9adcd0544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e261a113-db73-4d0b-b6a1-a1f9adcd0544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1462818264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99eef4a029349efb12a3798990e10e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:09Z,use_quota=True,user_id='9cdffc4061da4d3681698a53b4c76723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad6ccf0-7e04-4b27-b796-2fa10e59da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad6ccf0-7e04-4b27-b796-2fa10e59da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7735d538-8be0-4bdb-aaf4-51b0873fbc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7735d538-8be0-4bdb-aaf4-51b0873fbc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c', 'volume_name': 'volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef43c02-0d7e-4f24-8f98-4a5d41ea3afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef43c02-0d7e-4f24-8f98-4a5d41ea3afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bf4916-cc2f-4996-b2c6-314daa04de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:09 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Volume 7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c', 'volume_size': 1}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:09 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:09 devstack sudo[101271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.info
Jul 31 14:59:09 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:09 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.info" returned: 0 in 0.250s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:09 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:09 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.info
Jul 31 14:59:09 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:09 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.info" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.716s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-quobyte-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b-14598e72-4fde-4aa2-a041-7d4da84bd7ca" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b-14598e72-4fde-4aa2-a041-7d4da84bd7ca" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Creating volume 14598e72-4fde-4aa2-a041-7d4da84bd7ca from snapshot 1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-quobyte-14598e72-4fde-4aa2-a041-7d4da84bd7ca" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-14598e72-4fde-4aa2-a041-7d4da84bd7ca" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] snapshot: 1ad12d92-7698-4de1-8f1c-01a0ebf86e2b, volume: 14598e72-4fde-4aa2-a041-7d4da84bd7ca,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23652e42-1154-4206-a14e-b63d2a774114]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5193acd3-304c-4685-8a7b-706b2d2a61a0 tempest-GroupSnapshotsV319Test-1618650514 None] group_snapshot 961af6db-5a2e-48fd-8c57-553c6ede7ff2: created successfully
Jul 31 14:59:09 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b
Jul 31 14:59:09 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:10 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" returned: 0 in 0.366s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a446c1ff-3938-4232-8aa0-56ece0ccece2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] group_snapshot 961af6db-5a2e-48fd-8c57-553c6ede7ff2: deleting
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] group_snapshot 961af6db-5a2e-48fd-8c57-553c6ede7ff2: deleting {{(pid=88594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Acquiring lock "cinder-quobyte-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "cinder-quobyte-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Acquiring lock "cinder-quobyte-5c022bf0-c528-4e3d-b902-dede9c62bc6f" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "cinder-quobyte-5c022bf0-c528-4e3d-b902-dede9c62bc6f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Deleting offline snapshot 5c022bf0-c528-4e3d-b902-dede9c62bc6f of volume 7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:59:10 devstack sudo[101282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0
Jul 31 14:59:10 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] snapshot_file for this snap is: volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba07d90-0954-43c9-bfbd-9bc85ef8b44b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:10 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f
Jul 31 14:59:10 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:10 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:10 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca
Jul 31 14:59:10 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:10 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f" returned: 0 in 0.399s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d5d6d7-f6ba-4b10-91da-c82015c11b3b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:10 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f
Jul 31 14:59:10 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:11 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" returned: 0 in 0.466s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:11 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f
Jul 31 14:59:11 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:12 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f" returned: 0 in 0.906s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:12 devstack sudo[101315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f
Jul 31 14:59:12 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:12 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f.5c022bf0-c528-4e3d-b902-dede9c62bc6f" returned: 0 in 0.892s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "cinder-quobyte-5c022bf0-c528-4e3d-b902-dede9c62bc6f" released by "_delete_snapshot" :: held 2.819s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Lock "cinder-quobyte-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" released by "delete_snapshot" :: held 2.856s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:13 devstack cinder-volume[88594]: WARNING cinder.quota [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2039438685 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2039438685, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:13 devstack cinder-volume[88594]: WARNING cinder.quota [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2039438685 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2039438685, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:13 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] Created reservations ['b24fd5fc-62f0-4ba4-92e8-65d54c7c396a', '8363db37-f68e-406d-af1b-5c97ffa033b9', 'cb3aca51-6459-4ef9-9e7b-d17dfb3518bf', 'bc883980-644f-4fed-ae51-ccc2453fd1f4'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-af5c7f8e-58b5-45a0-926e-26c34f9c7228 tempest-GroupSnapshotsV319Test-1618650514 None] group_snapshot 961af6db-5a2e-48fd-8c57-553c6ede7ff2: deleted successfully
Jul 31 14:59:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Acquiring lock "cinder-quobyte-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Lock "cinder-quobyte-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:14 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8439916-13f2-43f4-9b08-d6d4eea7df68]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:14 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f
Jul 31 14:59:14 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:15 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" returned: 0 in 0.668s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:15 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f
Jul 31 14:59:15 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:15 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" returned: 0 in 0.631s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Lock "cinder-quobyte-7e862f8b-8ea9-4ee9-a10b-3597ec90aa9f" released by "delete_volume" :: held 1.450s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:16 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca" returned: 0 in 5.546s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:59:16 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Converted 1024.00 MB image at 184.59 MB/s
Jul 31 14:59:16 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca is being set with open permissions: ugo+rw
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:16 devstack sudo[101375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca
Jul 31 14:59:16 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Created reservations ['bc0421ca-46c1-4d32-b2f4-4f3b2a0c2b21'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:16 devstack cinder-volume[88594]: WARNING cinder.quota [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2039438685 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2039438685, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Created reservations ['ff1833b6-dfd8-4287-9fd4-06e0ae3f80aa', '96f47b78-ade8-4a01-ac21-3369ea0a349e', '02d50e8a-a750-43aa-8192-d524f7808afb', 'd6e500bb-5816-44a2-9a9b-e78f1f6962d5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:16 devstack sudo[101377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:16 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:16 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-14598e72-4fde-4aa2-a041-7d4da84bd7ca" released by "_copy_volume_from_snapshot" :: held 6.673s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b-14598e72-4fde-4aa2-a041-7d4da84bd7ca" released by "_create_volume_from_snapshot" :: held 6.740s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.763s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.311s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1462818264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99eef4a029349efb12a3798990e10e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:09Z,use_quota=True,user_id='9cdffc4061da4d3681698a53b4c76723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Creating volume 7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:16 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:16 devstack sudo[101380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c 1073741824
Jul 31 14:59:16 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0dcbf0d-dbcc-4c90-858c-412f93ac677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca', 'volume_size': 1, 'snapshot_id': '1ad12d92-7698-4de1-8f1c-01a0ebf86e2b'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a8b478-4782-4c04-aa37-fc2d05f66068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:16 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Volume volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca (14598e72-4fde-4aa2-a041-7d4da84bd7ca): created successfully
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a8b478-4782-4c04-aa37-fc2d05f66068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Flow 'volume_create_manager' (46af2e46-9ae9-45ce-a381-fbeb03745285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-29eca2fb-6e11-411f-bdfd-eae174127ea9 tempest-SnapshotDependencyTests-2136909144 None] Created volume successfully.
Jul 31 14:59:16 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d835a025-961f-4802-8d00-bd3b8c3be0fd tempest-GroupSnapshotsV319Test-1618650514 None] Delete group completed successfully.
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-quobyte-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-quobyte-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Deleting offline snapshot 1ad12d92-7698-4de1-8f1c-01a0ebf86e2b of volume f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] snapshot_file for this snap is: volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae8460e-771f-4c91-9531-52407f7d4b65]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:16 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c 1073741824" returned: 0 in 0.471s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:16 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b
Jul 31 14:59:16 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:16 devstack sudo[101388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c
Jul 31 14:59:16 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:17 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" returned: 0 in 0.244s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bf4916-cc2f-4996-b2c6-314daa04de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a0aec2-7d97-4729-bb23-8f6f889e091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:17 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:59:17 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Volume volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c (7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c): created successfully
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a0aec2-7d97-4729-bb23-8f6f889e091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Flow 'volume_create_manager' (09284022-81cc-404f-81ec-2965f8cd5590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebba84a-0c6f-434e-9d37-971a106fc098]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fca69f72-746f-4a41-9e39-dfcda9ed06af tempest-VolumesCloneTest-1042481270 None] Created volume successfully.
Jul 31 14:59:17 devstack sudo[101396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0
Jul 31 14:59:17 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:17 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" returned: 0 in 0.575s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:17 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b
Jul 31 14:59:17 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:18 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" returned: 0 in 0.401s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:18 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b
Jul 31 14:59:18 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Flow 'volume_create_manager' (166ef08e-2d67-40f6-83e8-6eb5a3f01a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:18 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedc0d79-0342-4cc3-9c02-789c8bcb4fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0.1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedc0d79-0342-4cc3-9c02-789c8bcb4fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1834371668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ea4e56-2526-4ea3-b5d9-fb230555f9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99eef4a029349efb12a3798990e10e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:18Z,use_quota=True,user_id='9cdffc4061da4d3681698a53b4c76723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82311374-e0da-46f3-a80c-0bb3773c3b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82311374-e0da-46f3-a80c-0bb3773c3b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc1eacb-ed03-4ed7-a16f-5119f5ea0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc1eacb-ed03-4ed7-a16f-5119f5ea0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '61ea4e56-2526-4ea3-b5d9-fb230555f9f6', 'volume_name': 'volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6', 'volume_size': 2, 'source_volid': '7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c', 'source_volstatus': 'available'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7bbb11-aee0-4bee-871a-979f1e6d5a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7bbb11-aee0-4bee-871a-979f1e6d5a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b1acb5-9d1d-482e-81d1-4d20cca19bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Volume 61ea4e56-2526-4ea3-b5d9-fb230555f9f6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6', 'volume_size': 2, 'source_volid': '7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c', 'source_volstatus': 'available'}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b" released by "_delete_snapshot" :: held 1.820s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:18 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Cloning volume 7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c to volume 61ea4e56-2526-4ea3-b5d9-fb230555f9f6
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" released by "delete_snapshot" :: held 1.853s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Creating offline snapshot ee8358ec-5490-4bf8-86e6-7b62a34dba2b of volume 7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9bce98-3ab5-45c2-af9f-c627c5b47517]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Created reservations ['d3c4e8ec-e36b-445a-93d4-3fdaa2965733', '09475018-b3ec-4b0c-a521-0ecc64d76e9c', '9bbb9a2b-4cc7-4c68-8a1a-9b00b78ad033', '39151410-9b4b-4170-b772-9cd170261728'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Delete snapshot completed successfully.
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6e8f0ded-c0ce-484e-9565-acdfa1f6ac03 tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-1ad12d92-7698-4de1-8f1c-01a0ebf86e2b-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:18 devstack sudo[101409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c
Jul 31 14:59:18 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-f113839b-3ac0-4abc-adcd-8c08e3ef40d0-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-f113839b-3ac0-4abc-adcd-8c08e3ef40d0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-quobyte-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a352941-b19e-4da4-b157-fd1be8445504]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:19 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" returned: 0 in 0.496s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:19 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0
Jul 31 14:59:19 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:19 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b 1G
Jul 31 14:59:19 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:19 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" returned: 0 in 0.504s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:19 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0
Jul 31 14:59:19 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:19 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b 1G" returned: 0 in 0.565s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:19 devstack sudo[101435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b
Jul 31 14:59:19 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:19 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" returned: 0 in 0.352s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-f113839b-3ac0-4abc-adcd-8c08e3ef40d0" released by "delete_volume" :: held 0.941s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Created reservations ['8a10a775-17f9-4f13-a42d-d1ed70de44b9', '55e2398c-d295-425e-9280-85c04fa730a5', 'cedb1926-6610-4404-88f4-9f0eca59c837', 'd91de1d1-5634-421f-a602-a59a368f5399'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:20 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b" returned: 0 in 0.435s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:20 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b is being set with open permissions: ugo+rw
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:20 devstack sudo[101450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:20 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:20 devstack sudo[101451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b
Jul 31 14:59:20 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-8a25f4d8-bcbf-454f-a7fa-c72d8515463e req-4cb5eff3-fd92-4b09-b819-ce7267fb2ac6 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:20 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:20 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.332s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Deleted volume successfully.
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b9ee7bdd-fa6e-4d94-9165-4b537c3d418f tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-f113839b-3ac0-4abc-adcd-8c08e3ef40d0-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:20 devstack sudo[101456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.info
Jul 31 14:59:20 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:20 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.info" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:20 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.info is being set with open permissions: ugo+rw
Jul 31 14:59:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:20 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.info
Jul 31 14:59:20 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:21 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.info" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Acquiring lock "cinder-quobyte-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] snapshot: ee8358ec-5490-4bf8-86e6-7b62a34dba2b, volume: 61ea4e56-2526-4ea3-b5d9-fb230555f9f6,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7e6a5e-09cd-47c5-8acd-f31ca9e8822b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-14598e72-4fde-4aa2-a041-7d4da84bd7ca-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-14598e72-4fde-4aa2-a041-7d4da84bd7ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:21 devstack sudo[101462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b
Jul 31 14:59:21 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "cinder-quobyte-14598e72-4fde-4aa2-a041-7d4da84bd7ca" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-14598e72-4fde-4aa2-a041-7d4da84bd7ca" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7568a62a-cb87-4085-abe9-fdd034e5e2f0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:21 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca
Jul 31 14:59:21 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:21 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b" returned: 0 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b69647-1579-4a99-a429-20ea01df94df]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:21 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c
Jul 31 14:59:21 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:21 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca" returned: 0 in 0.398s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:21 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca
Jul 31 14:59:21 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:21 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" returned: 0 in 0.401s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:21 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-14598e72-4fde-4aa2-a041-7d4da84bd7ca" returned: 0 in 0.256s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:21 devstack sudo[101481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6
Jul 31 14:59:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-quobyte-14598e72-4fde-4aa2-a041-7d4da84bd7ca" released by "delete_volume" :: held 0.702s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:21 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Created reservations ['c1b02bb1-577c-4d90-8b5a-6dfc83528b62', 'd9198046-5bbe-4f97-8c5a-32430de87d44', 'c220917a-46fd-4639-ac6d-ef4ac6988647', '2a25deb7-cde3-4582-8635-22621b693c9a'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:22 devstack sudo[101483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:22 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:22 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.278s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Deleted volume successfully.
Jul 31 14:59:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3ebd6d2-aa82-4d0a-a0fc-873ecb77dcac tempest-SnapshotDependencyTests-2136909144 None] Lock "cinder-14598e72-4fde-4aa2-a041-7d4da84bd7ca-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:27 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" returned: 0 in 5.644s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:59:27 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Converted 1024.00 MB image at 181.38 MB/s
Jul 31 14:59:27 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 is being set with open permissions: ugo+rw
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:27 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6
Jul 31 14:59:27 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:27 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" released by "_copy_volume_from_snapshot" :: held 6.825s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Acquiring lock "cinder-quobyte-ee8358ec-5490-4bf8-86e6-7b62a34dba2b" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-ee8358ec-5490-4bf8-86e6-7b62a34dba2b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Deleting offline snapshot ee8358ec-5490-4bf8-86e6-7b62a34dba2b of volume 7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] snapshot_file for this snap is: volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2658e36f-b1fa-44fa-b14b-be4e3a092339]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:28 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b
Jul 31 14:59:28 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:28 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b" returned: 0 in 0.516s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:59:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce40d49-b8b8-4570-a175-b5160b06d036]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:28 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c
Jul 31 14:59:28 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:29 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" returned: 0 in 0.651s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:29 devstack sudo[101520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b
Jul 31 14:59:29 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:29 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b" returned: 0 in 0.464s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:29 devstack sudo[101526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b
Jul 31 14:59:29 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:29 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c.ee8358ec-5490-4bf8-86e6-7b62a34dba2b" returned: 0 in 0.268s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-ee8358ec-5490-4bf8-86e6-7b62a34dba2b" released by "_delete_snapshot" :: held 2.006s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.416s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-8a25f4d8-bcbf-454f-a7fa-c72d8515463e req-4cb5eff3-fd92-4b09-b819-ce7267fb2ac6 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.755s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-8a25f4d8-bcbf-454f-a7fa-c72d8515463e req-4cb5eff3-fd92-4b09-b819-ce7267fb2ac6 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b1acb5-9d1d-482e-81d1-4d20cca19bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6', 'volume_size': 2, 'source_volid': '7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c', 'source_volstatus': 'available'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2417d0-c477-478e-ba44-e19faaffd3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Volume volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 (61ea4e56-2526-4ea3-b5d9-fb230555f9f6): created successfully
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2417d0-c477-478e-ba44-e19faaffd3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Flow 'volume_create_manager' (166ef08e-2d67-40f6-83e8-6eb5a3f01a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-8a25f4d8-bcbf-454f-a7fa-c72d8515463e req-4cb5eff3-fd92-4b09-b819-ce7267fb2ac6 tempest-TestInstancesWithCinderVolumes-1648250274 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-0afa3a32-b197-4295-895f-9930977e80fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77621e8d-4929-450c-8b97-9b8def495680', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:59:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-938a26e7-80b2-470e-8262-40b64331000d tempest-VolumesCloneTest-1042481270 None] Created volume successfully.
Jul 31 14:59:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-8a25f4d8-bcbf-454f-a7fa-c72d8515463e req-4cb5eff3-fd92-4b09-b819-ce7267fb2ac6 tempest-TestInstancesWithCinderVolumes-1648250274 None] attachment_update completed successfully.
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Acquiring lock "cinder-61ea4e56-2526-4ea3-b5d9-fb230555f9f6-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Lock "cinder-61ea4e56-2526-4ea3-b5d9-fb230555f9f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Acquiring lock "cinder-quobyte-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f7fc0-a63d-4a57-821b-91f7f35f8de1]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:31 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6
Jul 31 14:59:31 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-67df0d55-9bfb-4ae6-badc-ae00460a0f20 tempest-GroupsTest-1396857099 None] Group tempest-Group1-1819725061: creating
Jul 31 14:59:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-67df0d55-9bfb-4ae6-badc-ae00460a0f20 tempest-GroupsTest-1396857099 None] Group tempest-Group1-1819725061: created successfully
Jul 31 14:59:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-67df0d55-9bfb-4ae6-badc-ae00460a0f20 tempest-GroupsTest-1396857099 None] Create group completed successfully.
Jul 31 14:59:31 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" returned: 0 in 0.490s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:31 devstack sudo[101541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6
Jul 31 14:59:31 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:31 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" returned: 0 in 0.262s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-61ea4e56-2526-4ea3-b5d9-fb230555f9f6" released by "delete_volume" :: held 0.818s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Created reservations ['73fbedb5-261c-42fa-973f-672f9b7b28db', '54bd3724-2933-446b-888a-ca3f21fca7e0', 'd607ad91-f067-4eb0-80c1-01452080b5f4', 'bfd54fa0-45f7-45e6-b493-8fb79d32a76e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:31 devstack sudo[101550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:31 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:32 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.278s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Acquiring lock "cinder-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Deleted volume successfully.
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Lock "cinder-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c0259-ef45-44db-8afa-4b0268ca6c3c tempest-VolumesCloneTest-1042481270 None] Lock "cinder-61ea4e56-2526-4ea3-b5d9-fb230555f9f6-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Acquiring lock "cinder-quobyte-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f6afc-c47f-4d66-90c2-90b48f51801c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:32 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c
Jul 31 14:59:32 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b69e8dcb-26da-4777-a1b9-32c1b1fa8ee3 tempest-GroupsTest-1396857099 None] Group tempest-Group2-1597921331: creating
Jul 31 14:59:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b69e8dcb-26da-4777-a1b9-32c1b1fa8ee3 tempest-GroupsTest-1396857099 None] Group tempest-Group2-1597921331: created successfully
Jul 31 14:59:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b69e8dcb-26da-4777-a1b9-32c1b1fa8ee3 tempest-GroupsTest-1396857099 None] Create group completed successfully.
Jul 31 14:59:32 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" returned: 0 in 0.620s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:32 devstack sudo[101570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c
Jul 31 14:59:32 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eef8ebbc-e021-4745-be03-2b759520ee7e req-3b27ef34-aa4d-447d-a35a-37551e3b50e0 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eef8ebbc-e021-4745-be03-2b759520ee7e req-3b27ef34-aa4d-447d-a35a-37551e3b50e0 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-eef8ebbc-e021-4745-be03-2b759520ee7e req-3b27ef34-aa4d-447d-a35a-37551e3b50e0 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-eef8ebbc-e021-4745-be03-2b759520ee7e req-3b27ef34-aa4d-447d-a35a-37551e3b50e0 tempest-TestInstancesWithCinderVolumes-1648250274 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-a042aa8a-6bbe-469d-bd75-898e0dd57161', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f52cbae2-6aa3-41c3-8c01-a46cbd21b9f9', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 14:59:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-eef8ebbc-e021-4745-be03-2b759520ee7e req-3b27ef34-aa4d-447d-a35a-37551e3b50e0 tempest-TestInstancesWithCinderVolumes-1648250274 None] attachment_update completed successfully.
Jul 31 14:59:33 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" returned: 0 in 0.303s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Lock "cinder-quobyte-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c" released by "delete_volume" :: held 0.999s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Created reservations ['77e86b67-ce62-4c58-9f88-a7445cdc8895', 'b8d62c75-9cba-4739-9137-da548dea34ef', 'c37efb91-b73d-4b0d-be7e-c6b24055666d', '4bb3f8a4-8ffe-4c6a-9444-699c2208ed9a'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:33 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:33 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:33 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Deleted volume successfully.
Jul 31 14:59:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d5532b88-73b3-480f-aa41-929466f40922 tempest-VolumesCloneTest-1042481270 None] Lock "cinder-7f0fc2f4-e1c9-4b87-8bdb-bc52d27bca1c-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Flow 'volume_create_manager' (c37e3ce1-bc70-44df-8eac-2708ce4331d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cc5eda-2410-431b-97f9-6a70ec8e521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cc5eda-2410-431b-97f9-6a70ec8e521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225366348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9fd01b2f-f0d4-4624-82f4-cff47856520b,host='devstack@QuobyteHD#QuobyteHD',id=0681d93a-d599-45ec-9535-733dffab4a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524c5eca271b4fa0ac4919caac9fb875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:34Z,use_quota=True,user_id='06f7e02a909a48398eff7dce20936db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0c182f0-e62f-4258-941e-e00ed61dadd2),volume_type_id=e0c182f0-e62f-4258-941e-e00ed61dadd2)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70d5b74-c62c-470f-83e5-2bb489289cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70d5b74-c62c-470f-83e5-2bb489289cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefa4d04-6222-49be-9bde-b12cb9d84303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefa4d04-6222-49be-9bde-b12cb9d84303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0681d93a-d599-45ec-9535-733dffab4a3d', 'volume_name': 'volume-0681d93a-d599-45ec-9535-733dffab4a3d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4554b7-ff30-406e-b3d6-183ae7a93c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4554b7-ff30-406e-b3d6-183ae7a93c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab21072c-1cc8-41d7-ac1f-4dd1b248b80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:34 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Volume 0681d93a-d599-45ec-9535-733dffab4a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0681d93a-d599-45ec-9535-733dffab4a3d', 'volume_size': 1}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9fd01b2f-f0d4-4624-82f4-cff47856520b,created_at=2026-07-31T12:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225366348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9fd01b2f-f0d4-4624-82f4-cff47856520b,host='devstack@QuobyteHD#QuobyteHD',id=0681d93a-d599-45ec-9535-733dffab4a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524c5eca271b4fa0ac4919caac9fb875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:34Z,use_quota=True,user_id='06f7e02a909a48398eff7dce20936db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0c182f0-e62f-4258-941e-e00ed61dadd2),volume_type_id=e0c182f0-e62f-4258-941e-e00ed61dadd2)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Creating volume 0681d93a-d599-45ec-9535-733dffab4a3d {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:34 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:34 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d 1073741824
Jul 31 14:59:34 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:35 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d 1073741824" returned: 0 in 0.627s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:35 devstack sudo[101596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d
Jul 31 14:59:35 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:35 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab21072c-1cc8-41d7-ac1f-4dd1b248b80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0681d93a-d599-45ec-9535-733dffab4a3d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177440c2-0df9-40fe-bbe5-43975ee4447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:35 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Volume volume-0681d93a-d599-45ec-9535-733dffab4a3d (0681d93a-d599-45ec-9535-733dffab4a3d): created successfully
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177440c2-0df9-40fe-bbe5-43975ee4447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:35 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Flow 'volume_create_manager' (c37e3ce1-bc70-44df-8eac-2708ce4331d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9730dbe3-aeaa-4ab2-b4e5-15ddb8b69a18 tempest-GroupsTest-1396857099 None] Created volume successfully.
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Acquiring lock "cinder-quobyte-0681d93a-d599-45ec-9535-733dffab4a3d" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Lock "cinder-quobyte-0681d93a-d599-45ec-9535-733dffab4a3d" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[77045ee7-7ee8-43da-9217-1c1a84fd7620]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:37 devstack sudo[101605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d
Jul 31 14:59:37 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (940fb724-e61c-441c-af1c-ed1fc1bd13d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d02b8a6-2055-4d8a-a7b5-4bcd510e5ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d02b8a6-2055-4d8a-a7b5-4bcd510e5ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-495995384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65d0c9a-c75a-45fb-9e71-5e7010bc7526,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:38Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dcf020-590f-4653-ac33-013dec0d5ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dcf020-590f-4653-ac33-013dec0d5ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996ddda0-f79f-4c26-89c1-66511addf8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996ddda0-f79f-4c26-89c1-66511addf8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65d0c9a-c75a-45fb-9e71-5e7010bc7526', 'volume_name': 'volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0903b88-68fb-45ec-8775-2fb92945d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0903b88-68fb-45ec-8775-2fb92945d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d99f27e-9c49-4198-b2a4-5fd9ccdb6e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:37 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Volume d65d0c9a-c75a-45fb-9e71-5e7010bc7526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526', 'volume_size': 1}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-495995384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65d0c9a-c75a-45fb-9e71-5e7010bc7526,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:38Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Creating volume d65d0c9a-c75a-45fb-9e71-5e7010bc7526 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:37 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:37 devstack sudo[101615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526 1073741824
Jul 31 14:59:37 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:38 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d" returned: 0 in 0.403s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:38 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d
Jul 31 14:59:38 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:38 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0681d93a-d599-45ec-9535-733dffab4a3d" returned: 0 in 0.251s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Lock "cinder-quobyte-0681d93a-d599-45ec-9535-733dffab4a3d" released by "delete_volume" :: held 0.703s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Created reservations ['496abb0c-20f6-4c5d-b25d-091abd154c7e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:38 devstack cinder-volume[88594]: WARNING cinder.quota [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2144944288 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2144944288, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:38 devstack cinder-volume[88594]: WARNING cinder.quota [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2144944288 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2144944288, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Created reservations ['2b8a04ef-f897-43ae-a3d4-ca391154f8e9', '85f0f4ec-f703-4a3d-9cd6-807ae5716ba3', 'd5a450a1-08f8-460e-80c7-00d45768f84e', '8e49f78a-8318-42c8-b26a-97e4455f3272'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:38 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526 1073741824" returned: 0 in 0.500s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:38 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526
Jul 31 14:59:38 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:38 devstack sudo[101638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:38 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:38 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526" returned: 0 in 0.294s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d99f27e-9c49-4198-b2a4-5fd9ccdb6e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fd4667-bc48-47e1-bdb4-a6cbdd785f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Volume volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526 (d65d0c9a-c75a-45fb-9e71-5e7010bc7526): created successfully
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fd4667-bc48-47e1-bdb4-a6cbdd785f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (940fb724-e61c-441c-af1c-ed1fc1bd13d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:38 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3e32cf4f-9f48-43dd-9bde-6c74bed13f07 tempest-GroupsTest-1396857099 None] Delete group completed successfully.
Jul 31 14:59:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f5eb4401-fb1b-449e-a834-a18eef81b501 tempest-VolumesGetTest-1843243325 None] Created volume successfully.
Jul 31 14:59:38 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Created reservations ['440a8bfc-1afb-4736-b7fe-18fbc133ae0c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:39 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:39 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:39 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.252s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c9697d82-f993-4068-9e08-ed326111acef tempest-GroupsTest-1396857099 None] Delete group completed successfully.
Jul 31 14:59:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-6ea62112-4ee2-4f1d-b21e-597c10ecd248 req-0a200c91-193f-4a6d-bfea-315ee671c609 tempest-TestInstancesWithCinderVolumes-1648250274 None] Terminate volume connection completed successfully.
Jul 31 14:59:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-6ea62112-4ee2-4f1d-b21e-597c10ecd248 req-0a200c91-193f-4a6d-bfea-315ee671c609 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deleting attachment 77621e8d-4929-450c-8b97-9b8def495680. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "cinder-0afa3a32-b197-4295-895f-9930977e80fb-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-0afa3a32-b197-4295-895f-9930977e80fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "cinder-quobyte-0afa3a32-b197-4295-895f-9930977e80fb" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-quobyte-0afa3a32-b197-4295-895f-9930977e80fb" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1408772-accf-47c5-9d0b-24f9bba2cc42]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:40 devstack sudo[101654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb
Jul 31 14:59:40 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:40 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb" returned: 0 in 0.525s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:40 devstack sudo[101661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb
Jul 31 14:59:40 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (dbf6c082-1e56-4ad4-8987-5a01949e5206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a00f2f-d7f1-40b0-b6be-226b97b9e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a00f2f-d7f1-40b0-b6be-226b97b9e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-200776910',display_name='tempest-VolumesGetTest-Volume-1754369489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d2840e-1b4f-4724-b480-614ed632540a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:41Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee97fa3-a34b-4775-b4c7-01811ff3e360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee97fa3-a34b-4775-b4c7-01811ff3e360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d395387-512a-40be-8789-5d185c5b124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d395387-512a-40be-8789-5d185c5b124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d2840e-1b4f-4724-b480-614ed632540a', 'volume_name': 'volume-f2d2840e-1b4f-4724-b480-614ed632540a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad24a988-0a08-49d4-8e97-dd8ba35f3c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad24a988-0a08-49d4-8e97-dd8ba35f3c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678e17a9-f1f4-4888-88db-50a9f6907457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Volume f2d2840e-1b4f-4724-b480-614ed632540a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d2840e-1b4f-4724-b480-614ed632540a', 'volume_size': 1}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-200776910',display_name='tempest-VolumesGetTest-Volume-1754369489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d2840e-1b4f-4724-b480-614ed632540a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:41Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Creating volume f2d2840e-1b4f-4724-b480-614ed632540a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:40 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5e13df25-9583-41c2-8d98-f561c142d692 tempest-GroupsTest-1396857099 None] Group tempest-GroupsTest-Group-1334639515: creating
Jul 31 14:59:40 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a 1073741824
Jul 31 14:59:40 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5e13df25-9583-41c2-8d98-f561c142d692 tempest-GroupsTest-1396857099 None] Group tempest-GroupsTest-Group-1334639515: created successfully
Jul 31 14:59:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5e13df25-9583-41c2-8d98-f561c142d692 tempest-GroupsTest-1396857099 None] Create group completed successfully.
Jul 31 14:59:41 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0afa3a32-b197-4295-895f-9930977e80fb" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-quobyte-0afa3a32-b197-4295-895f-9930977e80fb" released by "delete_volume" :: held 0.854s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:41 devstack cinder-volume[88594]: WARNING cinder.quota [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517331283-1220698310 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517331283-1220698310, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:41 devstack cinder-volume[88594]: WARNING cinder.quota [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517331283-1220698310 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517331283-1220698310, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Created reservations ['b91ac3fa-37a1-4f34-9f98-88db0d3fb063', '0d9a5bcc-2eef-4b1f-8030-d6fb79480896', 'e84b5dd8-75e8-4740-b74b-a9f53dc8d238', 'bb8dd2fe-c829-4066-861c-adb231a5b6c2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:41 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:41 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:41 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a 1073741824" returned: 0 in 0.476s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:41 devstack sudo[101673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a
Jul 31 14:59:41 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:41 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deleted volume successfully.
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1431be8-10a5-4e99-be43-02f3bae5b856 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-0afa3a32-b197-4295-895f-9930977e80fb-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:41 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678e17a9-f1f4-4888-88db-50a9f6907457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d2840e-1b4f-4724-b480-614ed632540a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be48cfec-d4d2-40d2-a3b0-dce838d283ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:41 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Volume volume-f2d2840e-1b4f-4724-b480-614ed632540a (f2d2840e-1b4f-4724-b480-614ed632540a): created successfully
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be48cfec-d4d2-40d2-a3b0-dce838d283ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (dbf6c082-1e56-4ad4-8987-5a01949e5206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-56382191-2e24-4a7a-b4f8-81aa417da625 tempest-VolumesGetTest-1843243325 None] Created volume successfully.
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Flow 'volume_create_manager' (00bc0988-75b5-4d92-b504-bc80df9d8a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd15a9dc-0e2a-4dfc-9327-f5dd46b580be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd15a9dc-0e2a-4dfc-9327-f5dd46b580be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697834346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c615a76-ea12-4485-b468-5aea1da37124,host='devstack@QuobyteHD#QuobyteHD',id=d1735a84-02bb-400c-a2f1-ee2f92f8b5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524c5eca271b4fa0ac4919caac9fb875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:42Z,use_quota=True,user_id='06f7e02a909a48398eff7dce20936db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2788a5f-dff5-4064-8867-0bc0612ff872),volume_type_id=d2788a5f-dff5-4064-8867-0bc0612ff872)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5350a6b9-27da-4b3f-a4b7-f7d15f058690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5350a6b9-27da-4b3f-a4b7-f7d15f058690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dae152-31df-442e-85f7-3124978abd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dae152-31df-442e-85f7-3124978abd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1735a84-02bb-400c-a2f1-ee2f92f8b5e8', 'volume_name': 'volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b59141-3a47-4375-bf12-f9a974113660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b59141-3a47-4375-bf12-f9a974113660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cfb096-5e16-417a-864c-0ad604bcc279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Volume d1735a84-02bb-400c-a2f1-ee2f92f8b5e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8', 'volume_size': 1}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4c615a76-ea12-4485-b468-5aea1da37124,created_at=2026-07-31T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697834346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c615a76-ea12-4485-b468-5aea1da37124,host='devstack@QuobyteHD#QuobyteHD',id=d1735a84-02bb-400c-a2f1-ee2f92f8b5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524c5eca271b4fa0ac4919caac9fb875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:42Z,use_quota=True,user_id='06f7e02a909a48398eff7dce20936db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2788a5f-dff5-4064-8867-0bc0612ff872),volume_type_id=d2788a5f-dff5-4064-8867-0bc0612ff872)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Creating volume d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:42 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:42 devstack sudo[101683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 1073741824
Jul 31 14:59:42 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-f2d2840e-1b4f-4724-b480-614ed632540a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Lock "cinder-f2d2840e-1b4f-4724-b480-614ed632540a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-f2d2840e-1b4f-4724-b480-614ed632540a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-f2d2840e-1b4f-4724-b480-614ed632540a" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:42 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 1073741824" returned: 0 in 0.513s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[188f7e55-2ab2-4dc6-891a-ba2537eea9fd]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:43 devstack sudo[101702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8
Jul 31 14:59:43 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:43 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a
Jul 31 14:59:43 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:43 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8" returned: 0 in 0.251s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cfb096-5e16-417a-864c-0ad604bcc279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfa991c-912a-4efe-a607-422174b327c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:43 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Volume volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 (d1735a84-02bb-400c-a2f1-ee2f92f8b5e8): created successfully
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfa991c-912a-4efe-a607-422174b327c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Flow 'volume_create_manager' (00bc0988-75b5-4d92-b504-bc80df9d8a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-cf544a5d-5bbc-41fa-9603-95d1d3b0f23c tempest-GroupsTest-1396857099 None] Created volume successfully.
Jul 31 14:59:43 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a" returned: 0 in 0.412s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:43 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a
Jul 31 14:59:43 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:43 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f2d2840e-1b4f-4724-b480-614ed632540a" returned: 0 in 0.294s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-f2d2840e-1b4f-4724-b480-614ed632540a" released by "delete_volume" :: held 0.754s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Created reservations ['279ae55b-0e46-42fe-ad9e-a84221ee011e', 'b1495cb0-6027-48e0-ace5-3eda19db0631', 'ffc779db-4987-4aa3-9eb7-9b14c2a69376', 'a1ac7020-0c89-42cb-9fb1-be6764ba4352'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:43 devstack sudo[101718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:43 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:44 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-f27594fa-84c9-4a51-b3be-7f8d2f9d5d9c req-f0e5dcca-6dea-4c44-88fc-3b15be978bf0 tempest-TestInstancesWithCinderVolumes-1648250274 None] Terminate volume connection completed successfully.
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-f27594fa-84c9-4a51-b3be-7f8d2f9d5d9c req-f0e5dcca-6dea-4c44-88fc-3b15be978bf0 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deleting attachment f52cbae2-6aa3-41c3-8c01-a46cbd21b9f9. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:59:44 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:44 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Deleted volume successfully.
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-eb10b8bf-ab4f-4cf1-bb14-94569c37375e tempest-VolumesGetTest-1843243325 None] Lock "cinder-f2d2840e-1b4f-4724-b480-614ed632540a-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Flow 'volume_create_manager' (d8c7186a-4f3e-4fe3-bbf0-08e9241f9979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99e3540-0602-4257-a28d-83dbade381fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-d65d0c9a-c75a-45fb-9e71-5e7010bc7526-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99e3540-0602-4257-a28d-83dbade381fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-510931329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c615a76-ea12-4485-b468-5aea1da37124,host='devstack@QuobyteHD#QuobyteHD',id=f399698f-0d99-4d0b-8548-91e3280aa82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524c5eca271b4fa0ac4919caac9fb875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:44Z,use_quota=True,user_id='06f7e02a909a48398eff7dce20936db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2788a5f-dff5-4064-8867-0bc0612ff872),volume_type_id=d2788a5f-dff5-4064-8867-0bc0612ff872)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7d4f0d-01f1-4a5e-8a32-a3dc22be751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7d4f0d-01f1-4a5e-8a32-a3dc22be751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b084650e-3eb1-41cc-8bb0-18ffb121db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b084650e-3eb1-41cc-8bb0-18ffb121db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f399698f-0d99-4d0b-8548-91e3280aa82a', 'volume_name': 'volume-f399698f-0d99-4d0b-8548-91e3280aa82a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dc4cd7-6953-4b03-bdb2-af704c693efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dc4cd7-6953-4b03-bdb2-af704c693efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea4919f-3ca1-4fcf-9f38-de4cfa29b1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:44 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Volume f399698f-0d99-4d0b-8548-91e3280aa82a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f399698f-0d99-4d0b-8548-91e3280aa82a', 'volume_size': 1}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4c615a76-ea12-4485-b468-5aea1da37124,created_at=2026-07-31T12:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-510931329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c615a76-ea12-4485-b468-5aea1da37124,host='devstack@QuobyteHD#QuobyteHD',id=f399698f-0d99-4d0b-8548-91e3280aa82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524c5eca271b4fa0ac4919caac9fb875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:44Z,use_quota=True,user_id='06f7e02a909a48398eff7dce20936db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2788a5f-dff5-4064-8867-0bc0612ff872),volume_type_id=d2788a5f-dff5-4064-8867-0bc0612ff872)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Creating volume f399698f-0d99-4d0b-8548-91e3280aa82a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:44 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Lock "cinder-d65d0c9a-c75a-45fb-9e71-5e7010bc7526-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:44 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a 1073741824
Jul 31 14:59:44 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-d65d0c9a-c75a-45fb-9e71-5e7010bc7526" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-d65d0c9a-c75a-45fb-9e71-5e7010bc7526" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6376fa4-611b-4520-93b2-8ec707c7894d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:44 devstack sudo[101725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526
Jul 31 14:59:44 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "cinder-a042aa8a-6bbe-469d-bd75-898e0dd57161-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-a042aa8a-6bbe-469d-bd75-898e0dd57161-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "cinder-quobyte-a042aa8a-6bbe-469d-bd75-898e0dd57161" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-quobyte-a042aa8a-6bbe-469d-bd75-898e0dd57161" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdeeb58-1ba5-4163-a5a3-623e42f46853]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:44 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a 1073741824" returned: 0 in 0.514s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:44 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:44 devstack sudo[101733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161
Jul 31 14:59:44 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:44 devstack sudo[101735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526
Jul 31 14:59:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:44 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:44 devstack sudo[101738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a
Jul 31 14:59:44 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:45 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161" returned: 0 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:45 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:45 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d65d0c9a-c75a-45fb-9e71-5e7010bc7526" returned: 0 in 0.321s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:45 devstack sudo[101745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161
Jul 31 14:59:45 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea4919f-3ca1-4fcf-9f38-de4cfa29b1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f399698f-0d99-4d0b-8548-91e3280aa82a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6129b-9ab0-45fe-9794-de5396537457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-d65d0c9a-c75a-45fb-9e71-5e7010bc7526" released by "delete_volume" :: held 0.831s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:45 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Volume volume-f399698f-0d99-4d0b-8548-91e3280aa82a (f399698f-0d99-4d0b-8548-91e3280aa82a): created successfully
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6129b-9ab0-45fe-9794-de5396537457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Flow 'volume_create_manager' (d8c7186a-4f3e-4fe3-bbf0-08e9241f9979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-83066713-6916-4127-8fe3-14226131abb4 tempest-GroupsTest-1396857099 None] Created volume successfully.
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Created reservations ['6a4067fc-e58d-447b-a83a-731a8743a8c5', '87460c41-0427-44a1-bbb1-96397c702516', '2184adce-34c7-4969-9a74-96d9c4277173', '58fc37e5-f40d-42bb-8484-30a82b264fe9'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:45 devstack sudo[101747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:45 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:45 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a042aa8a-6bbe-469d-bd75-898e0dd57161" returned: 0 in 0.361s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-quobyte-a042aa8a-6bbe-469d-bd75-898e0dd57161" released by "delete_volume" :: held 0.818s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:45 devstack cinder-volume[88594]: WARNING cinder.quota [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411574426-673811035 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411574426-673811035, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:45 devstack cinder-volume[88594]: WARNING cinder.quota [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411574426-673811035 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411574426-673811035, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Created reservations ['0c958167-9b5f-46e4-89b9-e071597dd43a', '710b8f64-8325-422c-8e64-5c217369d3a9', 'c0b6abd5-fec2-447d-8863-d65d6cf6c507', '0e0b62a0-e901-4bc8-a09a-a097416b9e1b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bf43c50a-f0fc-4643-bd2b-0bcbc90e1bb5 tempest-GroupsTest-1396857099 None] Update group completed successfully.
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:45 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.281s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Deleted volume successfully.
Jul 31 14:59:45 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:45 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-271adf60-7b58-4ff5-a5ee-c1023f5a1dfd tempest-VolumesGetTest-1843243325 None] Lock "cinder-d65d0c9a-c75a-45fb-9e71-5e7010bc7526-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:46 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:46 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:46 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deleted volume successfully.
Jul 31 14:59:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f9d915ab-028b-411a-a224-8d467a2ecc73 tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-a042aa8a-6bbe-469d-bd75-898e0dd57161-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (c9bef0fe-869d-44cf-b119-ab0febd17204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff361137-3807-4f2d-b117-95d6a9fef7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff361137-3807-4f2d-b117-95d6a9fef7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-679771466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ff0854-c21d-4423-bd66-6eb410df9c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:47Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a01503-65af-485a-8def-004c080b25fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a01503-65af-485a-8def-004c080b25fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0bd51b-0620-4001-830a-763bc78cc92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0bd51b-0620-4001-830a-763bc78cc92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ff0854-c21d-4423-bd66-6eb410df9c70', 'volume_name': 'volume-a4ff0854-c21d-4423-bd66-6eb410df9c70', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f56a805-74dd-473c-93c3-aa2ca27bcb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f56a805-74dd-473c-93c3-aa2ca27bcb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1cc159-eb86-4e06-93cb-df27d1975fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:47 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Volume a4ff0854-c21d-4423-bd66-6eb410df9c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ff0854-c21d-4423-bd66-6eb410df9c70', 'volume_size': 1}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-679771466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ff0854-c21d-4423-bd66-6eb410df9c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:47Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Creating volume a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 14:59:47 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:47 devstack sudo[101756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 1073741824
Jul 31 14:59:47 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7ac03802-ab6f-4d04-8460-4057816fc8fb tempest-GroupsTest-1396857099 None] Update group completed successfully.
Jul 31 14:59:47 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 1073741824" returned: 0 in 0.610s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:47 devstack sudo[101771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70
Jul 31 14:59:47 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:48 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70" returned: 0 in 0.394s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1cc159-eb86-4e06-93cb-df27d1975fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ff0854-c21d-4423-bd66-6eb410df9c70', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f309a59f-2d09-459f-8026-29715b6294d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Volume volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 (a4ff0854-c21d-4423-bd66-6eb410df9c70): created successfully
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f309a59f-2d09-459f-8026-29715b6294d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (c9bef0fe-869d-44cf-b119-ab0febd17204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7b95d191-975d-417d-9922-2523fdbb13b3 tempest-VolumesGetTest-1843243325 None] Created volume successfully.
Jul 31 14:59:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Acquiring lock "cinder-quobyte-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Lock "cinder-quobyte-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c755c8-7996-40fa-b1c6-9b83cb0bd47b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:49 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8
Jul 31 14:59:49 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-b12a7b01-25c2-4c66-99b1-4c6e8ccd9c34 req-37d4a566-1988-4b9f-a14f-8d5efa77e8f8 tempest-TestInstancesWithCinderVolumes-1648250274 None] Terminate volume connection completed successfully.
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-b12a7b01-25c2-4c66-99b1-4c6e8ccd9c34 req-37d4a566-1988-4b9f-a14f-8d5efa77e8f8 tempest-TestInstancesWithCinderVolumes-1648250274 None] Deleting attachment 8403fdb3-c5ad-4656-83a7-725443427271. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 14:59:49 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8" returned: 0 in 0.471s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:49 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8
Jul 31 14:59:49 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (f981e282-0d4c-43aa-b8e0-181631cf9287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befeb346-838e-4674-ab12-402d772b9755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befeb346-838e-4674-ab12-402d772b9755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T12:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1061919014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afcb5f2-34b1-42c8-af3b-d56c947501aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T12:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a4ff0854-c21d-4423-bd66-6eb410df9c70,status='creating',terminated_at=None,updated_at=2026-07-31T12:59:50Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052bf844-356c-4ad6-a1fe-cb014fca183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052bf844-356c-4ad6-a1fe-cb014fca183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfa0a7b-84f5-4e67-a97f-35fb13c35e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:49 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8" returned: 0 in 0.329s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfa0a7b-84f5-4e67-a97f-35fb13c35e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8afcb5f2-34b1-42c8-af3b-d56c947501aa', 'volume_name': 'volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa', 'volume_size': 1, 'source_volid': 'a4ff0854-c21d-4423-bd66-6eb410df9c70', 'source_volstatus': 'available'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e734cfc-04f3-4f72-8758-f36370ac33f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e734cfc-04f3-4f72-8758-f36370ac33f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dad411-9381-4472-8082-14ed372614c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 14:59:49 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Volume 8afcb5f2-34b1-42c8-af3b-d56c947501aa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa', 'volume_size': 1, 'source_volid': 'a4ff0854-c21d-4423-bd66-6eb410df9c70', 'source_volstatus': 'available'}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Lock "cinder-quobyte-d1735a84-02bb-400c-a2f1-ee2f92f8b5e8" released by "delete_volume" :: held 0.874s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Acquiring lock "cinder-quobyte-f399698f-0d99-4d0b-8548-91e3280aa82a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:49 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Cloning volume a4ff0854-c21d-4423-bd66-6eb410df9c70 to volume 8afcb5f2-34b1-42c8-af3b-d56c947501aa
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Lock "cinder-quobyte-f399698f-0d99-4d0b-8548-91e3280aa82a" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde4f18-1ecd-49a8-b6cd-6ed920c6938e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Creating offline snapshot 5f387383-e7f7-4121-9f09-654e5a1f517f of volume a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30da653-01c4-4469-b636-9ee1dabca6ba]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:50 devstack sudo[101806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a
Jul 31 14:59:50 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "cinder-b9ac8203-f5ef-4249-965a-e3f3f982bb56-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-b9ac8203-f5ef-4249-965a-e3f3f982bb56-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:50 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70
Jul 31 14:59:50 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "cinder-quobyte-b9ac8203-f5ef-4249-965a-e3f3f982bb56" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-quobyte-b9ac8203-f5ef-4249-965a-e3f3f982bb56" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff8e72-0f34-4ccb-afd2-3d2642d9944e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:50 devstack sudo[101810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56
Jul 31 14:59:50 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:50 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a" returned: 0 in 0.445s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:50 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:50 devstack sudo[101819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a
Jul 31 14:59:50 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:50 devstack sudo[101820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f 1G
Jul 31 14:59:50 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:50 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56" returned: 0 in 0.427s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:50 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f399698f-0d99-4d0b-8548-91e3280aa82a" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:50 devstack sudo[101827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56
Jul 31 14:59:50 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Lock "cinder-quobyte-f399698f-0d99-4d0b-8548-91e3280aa82a" released by "delete_volume" :: held 0.763s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=195,cinder:SELECT=160,cinder:INSERT=42,cinder:DELETE=10 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=178,cinder:INSERT=44,cinder:UPDATE=178,cinder:DELETE=14 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Created reservations ['8d645e32-dede-4e5c-be0c-32d4b1b48f5b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:50 devstack cinder-volume[88594]: WARNING cinder.quota [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2061925770 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2061925770, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:50 devstack cinder-volume[88594]: WARNING cinder.quota [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2061925770 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2061925770, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Created reservations ['0d7af7a4-2eb7-423e-bec5-0a2e48c4ba6b', 'c32b5527-45de-40bf-bc03-4fbb36c151ee', '2ef99025-f12f-4d24-9872-df1c801132be', '80a416b2-c195-43ae-969a-51d1f6c71109'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:50 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f 1G" returned: 0 in 0.493s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:50 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b9ac8203-f5ef-4249-965a-e3f3f982bb56" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:50 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f
Jul 31 14:59:50 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Created reservations ['609163ee-cfe8-49a9-87b3-99e577b67dc0', '4a721a24-f897-4cb1-bf6b-08ea0cae21cc', '10503b94-a874-45bb-b051-767420030d64', '5822eea2-5047-4175-bfa5-05598771c741'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-quobyte-b9ac8203-f5ef-4249-965a-e3f3f982bb56" released by "delete_volume" :: held 0.772s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:50 devstack cinder-volume[88594]: WARNING cinder.quota [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868841746-455533325 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868841746-455533325, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:50 devstack cinder-volume[88594]: WARNING cinder.quota [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868841746-455533325 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868841746-455533325, it is now deprecated. Please use the default quota class for default quota.
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Created reservations ['49078e56-d4ba-473a-976f-b3986912a24d', '230cf191-0cf9-4716-8944-5aa7284cc109', '3088d8cb-ea38-4817-9e41-9174980d80f5', '9dd01196-10e9-4da8-b2f1-2b6269097b55'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:51 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:51 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:51 devstack sudo[101840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:51 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:51 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f" returned: 0 in 0.338s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:51 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f is being set with open permissions: ugo+rw
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:51 devstack sudo[101844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f
Jul 31 14:59:51 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:51 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.293s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2610f564-f467-4423-8bd2-c7c3131674ee tempest-GroupsTest-1396857099 None] Delete group completed successfully.
Jul 31 14:59:51 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.302s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Deleted volume successfully.
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc00f7bb-170e-49ca-a79b-0631ecb1fa5d tempest-TestInstancesWithCinderVolumes-1648250274 None] Lock "cinder-b9ac8203-f5ef-4249-965a-e3f3f982bb56-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:51 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f" returned: 0 in 0.288s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:51 devstack sudo[101849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.info
Jul 31 14:59:51 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:51 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.info" returned: 0 in 0.306s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:51 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.info is being set with open permissions: ugo+rw
Jul 31 14:59:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:51 devstack sudo[101852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.info
Jul 31 14:59:51 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:52 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.info" returned: 0 in 0.269s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-8afcb5f2-34b1-42c8-af3b-d56c947501aa" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-8afcb5f2-34b1-42c8-af3b-d56c947501aa" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] snapshot: 5f387383-e7f7-4121-9f09-654e5a1f517f, volume: 8afcb5f2-34b1-42c8-af3b-d56c947501aa,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee3e376-c204-4a0c-a933-bfc611a5d1fa]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:52 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f
Jul 31 14:59:52 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:52 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f" returned: 0 in 0.409s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ff0854-c21d-4423-bd66-6eb410df9c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d314f0-80c2-4782-8a79-3d5c0f38fb86]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:52 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70
Jul 31 14:59:52 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:53 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70" returned: 0 in 0.465s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 14:59:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 14:59:53 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 14:59:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:53 devstack sudo[101867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa
Jul 31 14:59:53 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:59:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 14:59:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 14:59:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:58 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 14:59:58 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:58 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.491s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 14:59:58 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa" returned: 0 in 5.678s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 14:59:58 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Converted 1024.00 MB image at 180.30 MB/s
Jul 31 14:59:58 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa is being set with open permissions: ugo+rw
Jul 31 14:59:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:58 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa
Jul 31 14:59:58 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:59 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa" returned: 0 in 0.273s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-8afcb5f2-34b1-42c8-af3b-d56c947501aa" released by "_copy_volume_from_snapshot" :: held 6.908s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-5f387383-e7f7-4121-9f09-654e5a1f517f" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-5f387383-e7f7-4121-9f09-654e5a1f517f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Deleting offline snapshot 5f387383-e7f7-4121-9f09-654e5a1f517f of volume a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] snapshot_file for this snap is: volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f904a73-137d-4b7d-93cb-59ebc65dd63f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:59 devstack sudo[101887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f
Jul 31 14:59:59 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 14:59:59 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f" returned: 0 in 0.426s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ff0854-c21d-4423-bd66-6eb410df9c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a071d8e-9f4e-453c-865b-6faccc7d379a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 14:59:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 14:59:59 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70
Jul 31 14:59:59 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e0c75f27-3263-40f2-b5dd-9f6a613a67f9 tempest-GroupsV314Test-706279189 None] Group tempest-GroupsV314Test-Group-1393921931: creating
Jul 31 15:00:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e0c75f27-3263-40f2-b5dd-9f6a613a67f9 tempest-GroupsV314Test-706279189 None] Group tempest-GroupsV314Test-Group-1393921931: created successfully
Jul 31 15:00:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e0c75f27-3263-40f2-b5dd-9f6a613a67f9 tempest-GroupsV314Test-706279189 None] Create group completed successfully.
Jul 31 15:00:00 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70" returned: 0 in 0.638s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:00 devstack sudo[101897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f
Jul 31 15:00:00 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:00 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f" returned: 0 in 0.387s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:00 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f
Jul 31 15:00:00 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:00 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70.5f387383-e7f7-4121-9f09-654e5a1f517f" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-5f387383-e7f7-4121-9f09-654e5a1f517f" released by "_delete_snapshot" :: held 1.814s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.058s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dad411-9381-4472-8082-14ed372614c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa', 'volume_size': 1, 'source_volid': 'a4ff0854-c21d-4423-bd66-6eb410df9c70', 'source_volstatus': 'available'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade1e455-87b0-4672-af76-227ec145166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:00 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Volume volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa (8afcb5f2-34b1-42c8-af3b-d56c947501aa): created successfully
Jul 31 15:00:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade1e455-87b0-4672-af76-227ec145166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (f981e282-0d4c-43aa-b8e0-181631cf9287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:01 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-cccc82ef-13d0-4bef-b6fa-21e71b7ffa16 tempest-VolumesGetTest-1843243325 None] Created volume successfully.
Jul 31 15:00:01 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:00:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Flow 'volume_create_manager' (3cf56dd4-1094-4387-baa6-a48c81f4f71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1575e318-25ed-473d-83d3-53d9919592a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1575e318-25ed-473d-83d3-53d9919592a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73922570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0239cf83-6cb1-403e-bfea-5f029915b57a,host='devstack@QuobyteHD#QuobyteHD',id=6823a05d-09d5-43b6-b31b-feba893ddb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9296f312242cba42c7b84041f9f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:02Z,use_quota=True,user_id='680cb77b10c5467b887705d6d37d0d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7ba464-9c4e-4860-a96e-05c7d2c94c59),volume_type_id=7b7ba464-9c4e-4860-a96e-05c7d2c94c59)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fcfa81-b8c2-46b0-b16a-22e0b74a4bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:01 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fcfa81-b8c2-46b0-b16a-22e0b74a4bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f7cfe2-21e5-4a99-bdb1-9e73c882877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f7cfe2-21e5-4a99-bdb1-9e73c882877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6823a05d-09d5-43b6-b31b-feba893ddb72', 'volume_name': 'volume-6823a05d-09d5-43b6-b31b-feba893ddb72', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4facac92-375d-4072-9c6e-2977580f7bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4facac92-375d-4072-9c6e-2977580f7bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d641ee99-9c1e-49a4-b0c0-f517481a3e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:02 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Volume 6823a05d-09d5-43b6-b31b-feba893ddb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6823a05d-09d5-43b6-b31b-feba893ddb72', 'volume_size': 1}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0239cf83-6cb1-403e-bfea-5f029915b57a,created_at=2026-07-31T13:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73922570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0239cf83-6cb1-403e-bfea-5f029915b57a,host='devstack@QuobyteHD#QuobyteHD',id=6823a05d-09d5-43b6-b31b-feba893ddb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9296f312242cba42c7b84041f9f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:02Z,use_quota=True,user_id='680cb77b10c5467b887705d6d37d0d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7ba464-9c4e-4860-a96e-05c7d2c94c59),volume_type_id=7b7ba464-9c4e-4860-a96e-05c7d2c94c59)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Creating volume 6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:00:02 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:02 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 1073741824
Jul 31 15:00:02 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:02 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 1073741824" returned: 0 in 0.527s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:02 devstack sudo[101913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72
Jul 31 15:00:02 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (552312af-848f-4c1b-bf4e-18d82da03e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98b661b-7157-4cae-8ab3-5b45d4314d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98b661b-7157-4cae-8ab3-5b45d4314d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1662120381',display_name='tempest-VolumesGetTest-Volume-504434817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f0857d-a108-4c96-9f80-20729d08d0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:03Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:02 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b120cfde-48f5-4e13-a640-a5a07139a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b120cfde-48f5-4e13-a640-a5a07139a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e88529-a771-424a-8a51-47ea6f270c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e88529-a771-424a-8a51-47ea6f270c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f0857d-a108-4c96-9f80-20729d08d0ba', 'volume_name': 'volume-16f0857d-a108-4c96-9f80-20729d08d0ba', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9945641e-72f7-4839-a5e1-b9a06ecd4014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9945641e-72f7-4839-a5e1-b9a06ecd4014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15c4b28-02af-46fe-ac07-5c774a47cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:03 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Volume 16f0857d-a108-4c96-9f80-20729d08d0ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f0857d-a108-4c96-9f80-20729d08d0ba', 'volume_size': 1}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72" returned: 0 in 0.393s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1662120381',display_name='tempest-VolumesGetTest-Volume-504434817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f0857d-a108-4c96-9f80-20729d08d0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:03Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Creating volume 16f0857d-a108-4c96-9f80-20729d08d0ba {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:00:03 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d641ee99-9c1e-49a4-b0c0-f517481a3e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6823a05d-09d5-43b6-b31b-feba893ddb72', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c805a42-9910-4f6c-adae-be348d481562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:03 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba 1073741824
Jul 31 15:00:03 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:03 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Volume volume-6823a05d-09d5-43b6-b31b-feba893ddb72 (6823a05d-09d5-43b6-b31b-feba893ddb72): created successfully
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c805a42-9910-4f6c-adae-be348d481562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Flow 'volume_create_manager' (3cf56dd4-1094-4387-baa6-a48c81f4f71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:03 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-05c74f86-3070-4aa7-bc94-397fd5e27fa4 tempest-GroupsV314Test-706279189 None] Created volume successfully.
Jul 31 15:00:03 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba 1073741824" returned: 0 in 0.497s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:03 devstack sudo[101923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba
Jul 31 15:00:03 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:03 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15c4b28-02af-46fe-ac07-5c774a47cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f0857d-a108-4c96-9f80-20729d08d0ba', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342cbbd4-35e8-43c5-a7c8-9cb82953485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:03 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Volume volume-16f0857d-a108-4c96-9f80-20729d08d0ba (16f0857d-a108-4c96-9f80-20729d08d0ba): created successfully
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342cbbd4-35e8-43c5-a7c8-9cb82953485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (552312af-848f-4c1b-bf4e-18d82da03e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:03 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6163fb1d-d145-4726-a38f-1dbb3d963397 tempest-VolumesGetTest-1843243325 None] Created volume successfully.
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:05 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Cloning volume 6823a05d-09d5-43b6-b31b-feba893ddb72 to volume f165a8ad-a21b-4a2a-b853-7d932d523cf9
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Creating offline snapshot 3d5c0b4f-b2cb-4f35-b678-bfff99872614 of volume 6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0ec97b-02b4-4eb6-8871-fa7304e25bc2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-16f0857d-a108-4c96-9f80-20729d08d0ba-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Lock "cinder-16f0857d-a108-4c96-9f80-20729d08d0ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-16f0857d-a108-4c96-9f80-20729d08d0ba" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-16f0857d-a108-4c96-9f80-20729d08d0ba" acquired by "delete_volume" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:05 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72
Jul 31 15:00:05 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[76325771-aadf-450c-8082-20315308d2bd]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:05 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba
Jul 31 15:00:05 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:05 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72" returned: 0 in 0.540s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:05 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 1G
Jul 31 15:00:05 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:05 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba" returned: 0 in 0.444s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:05 devstack sudo[101938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba
Jul 31 15:00:05 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:06 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-16f0857d-a108-4c96-9f80-20729d08d0ba" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-16f0857d-a108-4c96-9f80-20729d08d0ba" released by "delete_volume" :: held 0.791s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:06 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 1G" returned: 0 in 0.449s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6823a05d-09d5-43b6-b31b-feba893ddb72 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:06 devstack sudo[101944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6823a05d-09d5-43b6-b31b-feba893ddb72 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614
Jul 31 15:00:06 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Created reservations ['35185a4e-5d53-4e27-b0fc-bab68041266f', '4bc4a7c2-58b0-469b-acf4-60a5a4aed852', '5c0a6d9f-5da8-4024-ad73-1131b4116f09', 'e8e676dd-8a7e-41a2-a72c-f312acd311a9'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:06 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:06 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-8afcb5f2-34b1-42c8-af3b-d56c947501aa-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Lock "cinder-8afcb5f2-34b1-42c8-af3b-d56c947501aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-8afcb5f2-34b1-42c8-af3b-d56c947501aa" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:06 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6823a05d-09d5-43b6-b31b-feba893ddb72 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614" returned: 0 in 0.418s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:06 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:06 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-8afcb5f2-34b1-42c8-af3b-d56c947501aa" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:06 devstack sudo[101952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614
Jul 31 15:00:06 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.338s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Deleted volume successfully.
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5583ed3-b7d3-4d9d-a7eb-9d8cc36c2a00]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-57daec8e-67c0-4639-a2a4-539efd1b7ddf tempest-VolumesGetTest-1843243325 None] Lock "cinder-16f0857d-a108-4c96-9f80-20729d08d0ba-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:06 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa
Jul 31 15:00:06 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:06 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614" returned: 0 in 0.360s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:06 devstack sudo[101961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.info
Jul 31 15:00:06 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:07 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa" returned: 0 in 0.454s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:07 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa
Jul 31 15:00:07 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:07 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.info" returned: 0 in 0.330s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:07 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:07 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.info
Jul 31 15:00:07 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:07 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8afcb5f2-34b1-42c8-af3b-d56c947501aa" returned: 0 in 0.302s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-8afcb5f2-34b1-42c8-af3b-d56c947501aa" released by "delete_volume" :: held 0.836s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Created reservations ['b01a2132-199f-4ed5-9e18-b57d52dc4d26', '4005908e-2863-4849-8fc6-2a97669b7f28', 'be178be6-1813-4645-917b-88af764115ba', '1dabf313-1fb3-4cd4-8dfe-e1d744a386ba'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:07 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:07 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:07 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.info" returned: 0 in 0.298s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Acquiring lock "cinder-quobyte-f165a8ad-a21b-4a2a-b853-7d932d523cf9" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-f165a8ad-a21b-4a2a-b853-7d932d523cf9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] snapshot: 3d5c0b4f-b2cb-4f35-b678-bfff99872614, volume: f165a8ad-a21b-4a2a-b853-7d932d523cf9,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d693b3-2f85-4303-9bd1-ae799bcac4ae]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-a4ff0854-c21d-4423-bd66-6eb410df9c70-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Lock "cinder-a4ff0854-c21d-4423-bd66-6eb410df9c70-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:07 devstack sudo[101975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614
Jul 31 15:00:07 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:07 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:07 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Deleted volume successfully.
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-a4ff0854-c21d-4423-bd66-6eb410df9c70" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a09a55d9-70e9-47e2-b8c3-d775d94de6cc tempest-VolumesGetTest-1843243325 None] Lock "cinder-8afcb5f2-34b1-42c8-af3b-d56c947501aa-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-a4ff0854-c21d-4423-bd66-6eb410df9c70" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a43af-4c26-4a70-8ec4-5dea5f65a7fc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:08 devstack sudo[101978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70
Jul 31 15:00:08 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:08 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6823a05d-09d5-43b6-b31b-feba893ddb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fef2ef-5c85-464b-b266-74c055f5b1ce]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:08 devstack sudo[101983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72
Jul 31 15:00:08 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:08 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70" returned: 0 in 0.401s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:08 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70
Jul 31 15:00:08 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:08 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72" returned: 0 in 0.410s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9 not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:08 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9
Jul 31 15:00:08 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:08 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4ff0854-c21d-4423-bd66-6eb410df9c70" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-a4ff0854-c21d-4423-bd66-6eb410df9c70" released by "delete_volume" :: held 0.758s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Created reservations ['6e53d1ee-84eb-4546-9a39-84bacbc038ec', '70fa8b5b-9a4d-43be-9bb2-8bf46525e69d', '8dcb1d3a-afa5-49b8-8081-859a99654583', 'f94c8357-40f1-4309-85ac-7fb1c9320b4a'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:08 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:08 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:09 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:09 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Deleted volume successfully.
Jul 31 15:00:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-249ea614-4e8a-46d4-bc3c-d9309fbcbaec tempest-VolumesGetTest-1843243325 None] Lock "cinder-a4ff0854-c21d-4423-bd66-6eb410df9c70-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (97d30b52-6f78-4a2a-9202-0b6b49e88a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aac7fcc-be48-4ce5-ac56-799fad354a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aac7fcc-be48-4ce5-ac56-799fad354a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1413175120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac83d53-892b-4d1d-8b53-d8df45815294,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:11Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcbc989-da59-45ab-b9f9-ee3f8a3122c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcbc989-da59-45ab-b9f9-ee3f8a3122c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d519fb46-b60c-4092-986f-b0e3e65fb796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:10 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:00:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d519fb46-b60c-4092-986f-b0e3e65fb796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ac83d53-892b-4d1d-8b53-d8df45815294', 'volume_name': 'volume-5ac83d53-892b-4d1d-8b53-d8df45815294', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe494c770>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3017b343-954d-47d7-a267-175f5b4be0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3017b343-954d-47d7-a267-175f5b4be0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adeaa55-cb0f-44b1-85a6-2176f5c14380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Volume 5ac83d53-892b-4d1d-8b53-d8df45815294: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ac83d53-892b-4d1d-8b53-d8df45815294', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe494c770>}
Jul 31 15:00:11 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Trying to clone 5ac83d53-892b-4d1d-8b53-d8df45815294 from image 6ede671b-18a7-43c3-97de-ba07f3408159 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:00:12 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:00:12 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Image download 20.69 MB at 20.69 MB/s
Jul 31 15:00:12 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d35da5-0c48-4792-ad11-a07110bbde07]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:13 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD
Jul 31 15:00:13 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:14 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD" returned: 0 in 1.260s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 is fetched for user 60689dc85e984ea98eb807de6cfa88fd. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:00:14 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9" returned: 0 in 5.796s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:00:14 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Converted 1024.00 MB image at 176.60 MB/s
Jul 31 15:00:14 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9 is being set with open permissions: ugo+rw: NotImplementedError
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3356f7ad-5c61-4357-8f88-a47c89b91558]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:14 devstack sudo[102053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9
Jul 31 15:00:14 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:14 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD
Jul 31 15:00:14 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:14 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9" returned: 0 in 0.296s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-f165a8ad-a21b-4a2a-b853-7d932d523cf9" released by "_copy_volume_from_snapshot" :: held 7.040s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Acquiring lock "cinder-quobyte-3d5c0b4f-b2cb-4f35-b678-bfff99872614" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-3d5c0b4f-b2cb-4f35-b678-bfff99872614" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Deleting offline snapshot 3d5c0b4f-b2cb-4f35-b678-bfff99872614 of volume 6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] snapshot_file for this snap is: volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[659b8b4b-6f41-4fce-b0b8-c6f8b89b3b6e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:14 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:14 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614
Jul 31 15:00:14 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:15 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6823a05d-09d5-43b6-b31b-feba893ddb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:00:15 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97ea49d-df5a-4f31-8bdc-ed4d64f11fcb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:15 devstack sudo[102067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72
Jul 31 15:00:15 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:15 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72" returned: 0 in 0.667s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:15 devstack sudo[102072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614
Jul 31 15:00:15 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:16 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614" returned: 0 in 0.387s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:16 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614
Jul 31 15:00:16 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:16 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72.3d5c0b4f-b2cb-4f35-b678-bfff99872614" returned: 0 in 0.273s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-3d5c0b4f-b2cb-4f35-b678-bfff99872614" released by "_delete_snapshot" :: held 1.861s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.542s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1413175120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac83d53-892b-4d1d-8b53-d8df45815294,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:11Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Creating volume 5ac83d53-892b-4d1d-8b53-d8df45815294 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:00:16 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:00:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:16 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 1073741824
Jul 31 15:00:16 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fbb99948-f52a-44af-bd8f-7be0491933a9 tempest-GroupsV314Test-706279189 None] Create group from source-group-0239cf83-6cb1-403e-bfea-5f029915b57a completed successfully.
Jul 31 15:00:17 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 1073741824" returned: 0 in 0.513s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:17 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294
Jul 31 15:00:17 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:17 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294" returned: 0 in 0.298s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Attempting download of 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume 5ac83d53-892b-4d1d-8b53-d8df45815294. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Acquiring lock "cinder-quobyte-f165a8ad-a21b-4a2a-b853-7d932d523cf9" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-f165a8ad-a21b-4a2a-b853-7d932d523cf9" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb5e5ab-69bf-4942-8d4f-516a0a491abc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[192961f3-e644-42ad-9ac8-3bce2c3efedb]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_t2hwzvd2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:17 devstack sudo[102092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_t2hwzvd2
Jul 31 15:00:17 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:17 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9
Jul 31 15:00:17 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:18 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_t2hwzvd2" returned: 0 in 0.382s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_t2hwzvd2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:18 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_t2hwzvd2
Jul 31 15:00:18 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:18 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9" returned: 0 in 0.618s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:18 devstack sudo[102102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9
Jul 31 15:00:18 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:18 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_t2hwzvd2" returned: 1 in 0.418s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_t2hwzvd2' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2768bd7-3355-435a-90a6-e7f4766a0bec]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:18 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f165a8ad-a21b-4a2a-b853-7d932d523cf9" returned: 0 in 0.381s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:18 devstack sudo[102106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD
Jul 31 15:00:18 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-f165a8ad-a21b-4a2a-b853-7d932d523cf9" released by "delete_volume" :: held 1.071s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Created reservations ['16f73352-dd1b-4864-8bee-0d070066c87b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:18 devstack cinder-volume[88594]: WARNING cinder.quota [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1201451208 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1201451208, it is now deprecated. Please use the default quota class for default quota.
Jul 31 15:00:18 devstack cinder-volume[88594]: WARNING cinder.quota [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1201451208 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1201451208, it is now deprecated. Please use the default quota class for default quota.
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Created reservations ['ced7cc5b-09f7-48d3-86cb-c31fdadfe7ef', 'a423f942-1dae-4a9f-8c60-8d654ef55cad', 'c633e36c-0b0a-4c52-bcee-d8cb1813f54a', 'd8e8ad08-a4bc-4b61-b3e6-3ed549191f00'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:18 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] 6ede671b-18a7-43c3-97de-ba07f3408159 was qcow2, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:00:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:18 devstack sudo[102113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:18 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:18 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294
Jul 31 15:00:18 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:19 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.278s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:19 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:19 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2f359644-d357-4cad-adbe-878eee965f2d tempest-GroupsV314Test-706279189 None] Delete group completed successfully.
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Acquiring lock "cinder-quobyte-6823a05d-09d5-43b6-b31b-feba893ddb72" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-6823a05d-09d5-43b6-b31b-feba893ddb72" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad516d0a-3915-4b96-8306-a6fbbabcb973]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:20 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72
Jul 31 15:00:20 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:20 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72" returned: 0 in 0.423s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:20 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72
Jul 31 15:00:20 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:20 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294" returned: 0 in 1.942s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_cw6wfqiodevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:00:20 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Converted 112.00 MB image at 57.62 MB/s
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:20 devstack sudo[102132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 1G
Jul 31 15:00:20 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:20 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6823a05d-09d5-43b6-b31b-feba893ddb72" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Lock "cinder-quobyte-6823a05d-09d5-43b6-b31b-feba893ddb72" released by "delete_volume" :: held 0.760s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Created reservations ['ef4bdc55-5720-419f-9482-3be877b4ffff'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Created reservations ['79524331-9434-4a58-bb6f-da5ae218af9c', 'a5bc6e80-4456-43e2-adb9-d7a68718b9b4', 'b39c8db6-6a75-4d9c-822c-cd2583f4610f', 'a9899e35-5043-4192-8766-f5822c58900d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:21 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 1G" returned: 0 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Downloaded image 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume 5ac83d53-892b-4d1d-8b53-d8df45815294 successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 for user 60689dc85e984ea98eb807de6cfa88fd is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Marking volume 5ac83d53-892b-4d1d-8b53-d8df45815294 as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Copying metadata from image 6ede671b-18a7-43c3-97de-ba07f3408159 to 5ac83d53-892b-4d1d-8b53-d8df45815294. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Creating volume glance metadata for volume 5ac83d53-892b-4d1d-8b53-d8df45815294 backed by image 6ede671b-18a7-43c3-97de-ba07f3408159 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:21 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:21 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adeaa55-cb0f-44b1-85a6-2176f5c14380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac83d53-892b-4d1d-8b53-d8df45815294', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe494c770>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3414f57b-1df8-4ee6-8894-0bfb5c8fbcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:21 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Volume volume-5ac83d53-892b-4d1d-8b53-d8df45815294 (5ac83d53-892b-4d1d-8b53-d8df45815294): created successfully
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3414f57b-1df8-4ee6-8894-0bfb5c8fbcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (97d30b52-6f78-4a2a-9202-0b6b49e88a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0b9890b0-a306-456d-a41a-b49132ca4cdd tempest-VolumesGetTest-1843243325 None] Created volume successfully.
Jul 31 15:00:21 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.273s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:21 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a453d2ae-be13-4624-b663-94984e9d59f0 tempest-GroupsV314Test-706279189 None] Delete group completed successfully.
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (e5ed787a-5eeb-4706-90e5-706c3e69afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851a76ab-9d07-4f9e-8e78-0338aec306e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851a76ab-9d07-4f9e-8e78-0338aec306e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-648405418',display_name='tempest-VolumesGetTest-Volume-931192826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccffe534-fc29-4b0d-ac9a-9a81d5efddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:22Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2ad621-2dae-49f6-bf23-40d089fc159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2ad621-2dae-49f6-bf23-40d089fc159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0077111-4a0a-40f2-aaa3-27805dcbb9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0077111-4a0a-40f2-aaa3-27805dcbb9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccffe534-fc29-4b0d-ac9a-9a81d5efddb4', 'volume_name': 'volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7166522e-dea0-4fa9-87fb-63ef01451d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7166522e-dea0-4fa9-87fb-63ef01451d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775290a5-f392-4bbd-83dc-affde383e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:22 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Volume ccffe534-fc29-4b0d-ac9a-9a81d5efddb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4', 'volume_size': 1}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-648405418',display_name='tempest-VolumesGetTest-Volume-931192826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccffe534-fc29-4b0d-ac9a-9a81d5efddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f8a06c13be451ba07a573473090279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:22Z,use_quota=True,user_id='60689dc85e984ea98eb807de6cfa88fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Creating volume ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:00:22 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:00:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:22 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 1073741824
Jul 31 15:00:22 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:23 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 1073741824" returned: 0 in 0.512s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:23 devstack sudo[102149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4
Jul 31 15:00:23 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:23 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4" returned: 0 in 0.395s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775290a5-f392-4bbd-83dc-affde383e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc27cd33-1c5e-4480-9afd-5466eba5e942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Volume volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 (ccffe534-fc29-4b0d-ac9a-9a81d5efddb4): created successfully
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc27cd33-1c5e-4480-9afd-5466eba5e942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Flow 'volume_create_manager' (e5ed787a-5eeb-4706-90e5-706c3e69afed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:23 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9edaf6c8-47b5-47aa-bd5e-c76b9c03a3ae tempest-VolumesGetTest-1843243325 None] Created volume successfully.
Jul 31 15:00:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Lock "cinder-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:24 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67437be-37bc-4a19-95d6-cd659f4f5bd2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:25 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4
Jul 31 15:00:25 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:25 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4" returned: 0 in 0.458s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:25 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4
Jul 31 15:00:25 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:25 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4" returned: 0 in 0.301s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4" released by "delete_volume" :: held 0.819s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Created reservations ['1fd78875-7258-435b-8be5-753ef1849960', 'fdfaf8fa-4ff1-4fbc-b976-f32c6b77ed21', 'd43c9723-352f-4f78-bdcd-d8427c352e5d', 'dcc65d15-700a-4b18-a7d1-5f6f1009f86b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:25 devstack sudo[102166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:25 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-5ac83d53-892b-4d1d-8b53-d8df45815294-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Lock "cinder-5ac83d53-892b-4d1d-8b53-d8df45815294-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Acquiring lock "cinder-quobyte-5ac83d53-892b-4d1d-8b53-d8df45815294" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-5ac83d53-892b-4d1d-8b53-d8df45815294" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:26 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.397s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:26 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Deleted volume successfully.
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[de758a97-50a9-4353-9eab-b34535a3282e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-fad902d4-f5b0-4558-9084-c38ec07fd9ca tempest-VolumesGetTest-1843243325 None] Lock "cinder-ccffe534-fc29-4b0d-ac9a-9a81d5efddb4-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:26 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294
Jul 31 15:00:26 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:26 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294" returned: 0 in 0.460s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:26 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294
Jul 31 15:00:26 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:27 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5ac83d53-892b-4d1d-8b53-d8df45815294" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Lock "cinder-quobyte-5ac83d53-892b-4d1d-8b53-d8df45815294" released by "delete_volume" :: held 0.811s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Created reservations ['ae97d8b3-e427-4883-9764-ecbf732f6d4d', '319ada21-cb79-472b-b376-a3bd6901f1e4', '4fa129c3-4108-4fa8-8dc4-2fb50b7e17ce', 'e49b46fd-6cfe-4385-8f67-5a9200cb8fa8'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:27 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:27 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:27 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Deleted volume successfully.
Jul 31 15:00:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8a2b08d5-5f1d-4b3e-830c-76682ce18813 tempest-VolumesGetTest-1843243325 None] Lock "cinder-5ac83d53-892b-4d1d-8b53-d8df45815294-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Flow 'volume_create_manager' (a5e8a0ad-247e-4fcb-b4da-8b8dba0d6ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04588f55-3773-49ba-9efc-678598c1c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04588f55-3773-49ba-9efc-678598c1c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2126905745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c72ef9-eb62-4530-b3f9-77c573a8bd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc7215138c74b7a8d90f99869093927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:31Z,use_quota=True,user_id='07bd15ba6e6941c18ad3266b092dec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34cc557-937f-4c2d-9db5-65ad8db79b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34cc557-937f-4c2d-9db5-65ad8db79b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f68895-618a-493b-acd7-20de7e1b63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f68895-618a-493b-acd7-20de7e1b63fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c72ef9-eb62-4530-b3f9-77c573a8bd0b', 'volume_name': 'volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256d60cc-a5a9-4c62-8b81-c955b80509d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256d60cc-a5a9-4c62-8b81-c955b80509d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07c5b41-3407-4815-ba03-d9d98de862bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Volume b8c72ef9-eb62-4530-b3f9-77c573a8bd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b', 'volume_size': 1}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2126905745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c72ef9-eb62-4530-b3f9-77c573a8bd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc7215138c74b7a8d90f99869093927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:31Z,use_quota=True,user_id='07bd15ba6e6941c18ad3266b092dec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Creating volume b8c72ef9-eb62-4530-b3f9-77c573a8bd0b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:00:31 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:00:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:31 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b 1073741824
Jul 31 15:00:31 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:32 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b 1073741824" returned: 0 in 0.571s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:32 devstack sudo[102188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b
Jul 31 15:00:32 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:32 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07c5b41-3407-4815-ba03-d9d98de862bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efce7525-b0d1-46e6-ab74-f1783f4ac56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:32 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Volume volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b (b8c72ef9-eb62-4530-b3f9-77c573a8bd0b): created successfully
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efce7525-b0d1-46e6-ab74-f1783f4ac56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Flow 'volume_create_manager' (a5e8a0ad-247e-4fcb-b4da-8b8dba0d6ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a7616897-1642-4b97-a836-3a08b2d50d42 tempest-VolumesNegativeTest-4878075 None] Created volume successfully.
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Flow 'volume_create_manager' (e23188cd-8e32-40f5-a998-625aca8165ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5473f4e-0f87-4f7e-821c-71d4667addd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5473f4e-0f87-4f7e-821c-71d4667addd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-41916490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21128f55-621b-4cd4-8bb1-1146e1d7bef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd5c0287fb54944803d669f911e6348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:33Z,use_quota=True,user_id='bdf6725e814f40ebba24480d4b2476d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438cbb9c-0405-44b6-972a-54b5d1eb4876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438cbb9c-0405-44b6-972a-54b5d1eb4876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142a0cf4-173f-49d0-8274-a0b4d8d68523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142a0cf4-173f-49d0-8274-a0b4d8d68523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21128f55-621b-4cd4-8bb1-1146e1d7bef3', 'volume_name': 'volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6766de0-1816-4f33-99fc-dba2f59d83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6766de0-1816-4f33-99fc-dba2f59d83a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0937900e-949d-4875-a348-7499f6bf8fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:33 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Volume 21128f55-621b-4cd4-8bb1-1146e1d7bef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3', 'volume_size': 1}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-41916490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21128f55-621b-4cd4-8bb1-1146e1d7bef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd5c0287fb54944803d669f911e6348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:00:33Z,use_quota=True,user_id='bdf6725e814f40ebba24480d4b2476d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Creating volume 21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:00:33 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:33 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 1073741824
Jul 31 15:00:33 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:33 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 1073741824" returned: 0 in 0.569s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:34 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3
Jul 31 15:00:34 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:34 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3" returned: 0 in 0.384s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0937900e-949d-4875-a348-7499f6bf8fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e62e27b-e4fd-4bab-86d1-cf7b65f977b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:00:34 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Volume volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 (21128f55-621b-4cd4-8bb1-1146e1d7bef3): created successfully
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e62e27b-e4fd-4bab-86d1-cf7b65f977b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:00:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Flow 'volume_create_manager' (e23188cd-8e32-40f5-a998-625aca8165ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:00:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d22e7f31-b3ec-4ebf-b43a-6f09a887c0d6 tempest-TestStampPattern-920762642 None] Created volume successfully.
Jul 31 15:00:44 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=84,cinder:INSERT=39,cinder:UPDATE=113,cinder:DELETE=5 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:00:44 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=91,cinder:UPDATE=118,cinder:INSERT=27,cinder:DELETE=8 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:00:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Acquiring lock "cinder-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Lock "cinder-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Acquiring lock "cinder-quobyte-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:00:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Lock "cinder-quobyte-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:00:56 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6024a74a-003a-4b45-a6a2-c85439a93972]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:00:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:56 devstack sudo[102436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b
Jul 31 15:00:56 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:57 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b" returned: 0 in 0.403s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:57 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b
Jul 31 15:00:57 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:57 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Lock "cinder-quobyte-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b" released by "delete_volume" :: held 0.724s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Created reservations ['de4b8d47-5e10-4aa1-9aef-097604048887', 'cf3fbe67-76a8-4af8-8450-512e5f762ab5', '7bb64f25-2271-4d19-8534-0648fed12898', '55c2c224-c1fa-46eb-8ede-70d46c795416'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:57 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:57 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:57 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.421s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:00:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:00:58 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Deleted volume successfully.
Jul 31 15:00:58 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:00:58 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ebf09d2-6bac-476c-8ea7-060e1212d373 tempest-VolumesNegativeTest-4878075 None] Lock "cinder-b8c72ef9-eb62-4530-b3f9-77c573a8bd0b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:00:58 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:00:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:01:07 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:01:08 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:01:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-4beb242f-5b4a-4f45-a15e-e364c84cd861 req-5f4f73a2-18e4-49a9-b407-5316b0512401 tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-4beb242f-5b4a-4f45-a15e-e364c84cd861 req-5f4f73a2-18e4-49a9-b407-5316b0512401 tempest-TestStampPattern-920762642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-4beb242f-5b4a-4f45-a15e-e364c84cd861 req-5f4f73a2-18e4-49a9-b407-5316b0512401 tempest-TestStampPattern-920762642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-4beb242f-5b4a-4f45-a15e-e364c84cd861 req-5f4f73a2-18e4-49a9-b407-5316b0512401 tempest-TestStampPattern-920762642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01a75d2e-f7e8-43c5-aa8e-12f0084af265', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 15:01:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-4beb242f-5b4a-4f45-a15e-e364c84cd861 req-5f4f73a2-18e4-49a9-b407-5316b0512401 tempest-TestStampPattern-920762642 None] attachment_update completed successfully.
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (8ed3fe00-2626-40df-8e93-db29c843745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5386f88-35f6-4a07-bdce-716f4eac33d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5386f88-35f6-4a07-bdce-716f4eac33d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572758961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c07c0c-b6c4-4944-a0c9-0127f2d86a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:14Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb4a03c-61ab-4133-9fd3-0cc4c777940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb4a03c-61ab-4133-9fd3-0cc4c777940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b9a6a0-80a2-4e21-a9cf-49bb83004e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b9a6a0-80a2-4e21-a9cf-49bb83004e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c07c0c-b6c4-4944-a0c9-0127f2d86a63', 'volume_name': 'volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fe322e-849b-4970-a6db-902e2efbb6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fe322e-849b-4970-a6db-902e2efbb6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3f74f6-26d1-4b8a-bcfe-76dfaaab1490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:14 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Volume a9c07c0c-b6c4-4944-a0c9-0127f2d86a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63', 'volume_size': 1}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572758961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c07c0c-b6c4-4944-a0c9-0127f2d86a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:14Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Creating volume a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:14 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:01:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:14 devstack sudo[102939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 1073741824
Jul 31 15:01:14 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:15 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 1073741824" returned: 0 in 0.565s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:15 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63
Jul 31 15:01:15 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:15 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" returned: 0 in 0.274s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3f74f6-26d1-4b8a-bcfe-76dfaaab1490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934b5714-31d7-4ba7-9182-9ab115491658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:15 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Volume volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 (a9c07c0c-b6c4-4944-a0c9-0127f2d86a63): created successfully
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934b5714-31d7-4ba7-9182-9ab115491658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (8ed3fe00-2626-40df-8e93-db29c843745d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:15 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6034c9c3-060c-44b7-9db8-3d0fbf96219b tempest-VolumesSnapshotTestJSON-912197857 None] Created volume successfully.
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Creating offline snapshot 757c36f3-375b-4ca9-a3d3-826ba758c3d9 of volume a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81c9266-fdcf-4111-ac1c-991431a4f0fc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:17 devstack sudo[102961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63
Jul 31 15:01:17 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:17 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" returned: 0 in 0.497s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:17 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 1G
Jul 31 15:01:17 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-db7114b4-ef4b-4df4-bb46-573375cc4412 req-fd1e3e4f-2f84-47a5-abd5-d1e62ad14d53 tempest-TestStampPattern-920762642 None] Terminate volume connection completed successfully.
Jul 31 15:01:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-db7114b4-ef4b-4df4-bb46-573375cc4412 req-fd1e3e4f-2f84-47a5-abd5-d1e62ad14d53 tempest-TestStampPattern-920762642 None] Deleting attachment 01a75d2e-f7e8-43c5-aa8e-12f0084af265. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 15:01:18 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 1G" returned: 0 in 0.828s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:18 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9
Jul 31 15:01:18 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:18 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9" returned: 0 in 0.412s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:18 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 is being set with open permissions: ugo+rw
Jul 31 15:01:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:18 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9
Jul 31 15:01:18 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:19 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9" returned: 0 in 0.290s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:19 devstack sudo[103010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.info
Jul 31 15:01:19 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:19 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.info" returned: 0 in 0.265s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:19 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.info is being set with open permissions: ugo+rw
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:19 devstack sudo[103013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.info
Jul 31 15:01:19 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:19 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.info" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.058s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Creating offline snapshot 9fb47b81-d579-48ff-8286-d20d588619e8 of volume 21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b914dd72-49c0-46bd-b5e4-02060999e3ef]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:19 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-97896333-0f9a-4fda-9f8a-7a129a0faad5 tempest-VolumesSnapshotTestJSON-912197857 None] Create snapshot completed successfully
Jul 31 15:01:19 devstack sudo[103019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3
Jul 31 15:01:19 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:20 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3" returned: 0 in 0.398s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:20 devstack sudo[103025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 1G
Jul 31 15:01:20 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-757c36f3-375b-4ca9-a3d3-826ba758c3d9-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-757c36f3-375b-4ca9-a3d3-826ba758c3d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-757c36f3-375b-4ca9-a3d3-826ba758c3d9" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-757c36f3-375b-4ca9-a3d3-826ba758c3d9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Deleting offline snapshot 757c36f3-375b-4ca9-a3d3-826ba758c3d9 of volume a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] snapshot_file for this snap is: volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9042b5-3e11-4a29-8fe6-f8cafe3ac4a5]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:20 devstack sudo[103030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9
Jul 31 15:01:20 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:20 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 1G" returned: 0 in 0.521s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:20 devstack sudo[103032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8
Jul 31 15:01:20 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:20 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9" returned: 0 in 0.454s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f1fab5-2a0c-4aeb-a0ac-4e1522f8d45c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:21 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8" returned: 0 in 0.412s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:21 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 is being set with open permissions: ugo+rw
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:21 devstack sudo[103041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8
Jul 31 15:01:21 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:21 devstack sudo[103040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63
Jul 31 15:01:21 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:21 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8" returned: 0 in 0.330s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:21 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" returned: 0 in 0.460s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:21 devstack sudo[103052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9
Jul 31 15:01:21 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:21 devstack sudo[103053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.info
Jul 31 15:01:21 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:21 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.info" returned: 0 in 0.336s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:21 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.info is being set with open permissions: ugo+rw
Jul 31 15:01:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:21 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.info
Jul 31 15:01:21 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:22 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9" returned: 0 in 0.557s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:22 devstack sudo[103075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9
Jul 31 15:01:22 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:22 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.info" returned: 0 in 0.344s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9e26543b-81d9-4c5c-ba1b-4d17a3039b41 tempest-TestStampPattern-920762642 None] Create snapshot completed successfully
Jul 31 15:01:22 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63.757c36f3-375b-4ca9-a3d3-826ba758c3d9" returned: 0 in 0.276s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-757c36f3-375b-4ca9-a3d3-826ba758c3d9" released by "_delete_snapshot" :: held 1.876s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" released by "delete_snapshot" :: held 1.905s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['820db0e0-a4e9-4cc9-9488-1296afe739d7', 'cf616006-5d11-4041-9208-d6494c8a06a1', 'e9f87220-9dd1-4d3c-aaf1-39cdc66e9caf', '66867763-fcdc-4f88-93c9-61d1971c795b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Delete snapshot completed successfully.
Jul 31 15:01:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ca08905c-bb2e-40cb-b663-ad216b135cb1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-757c36f3-375b-4ca9-a3d3-826ba758c3d9-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (1b21be53-82cd-4ef6-9121-0c4228fd7d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e6b8ff-01b6-4b8d-a007-d18f06c16a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e6b8ff-01b6-4b8d-a007-d18f06c16a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1788089535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bad031-c28f-4ef0-bded-276c5e6e3ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:23Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a81fc-1d47-46a5-9343-a359acff3f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a81fc-1d47-46a5-9343-a359acff3f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe239a86-6a30-404f-a46a-c6cd03eda46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe239a86-6a30-404f-a46a-c6cd03eda46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bad031-c28f-4ef0-bded-276c5e6e3ff1', 'volume_name': 'volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d50a87-4123-4ad8-8407-81e1140d9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d50a87-4123-4ad8-8407-81e1140d9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f46052c-0ab6-4d90-9181-d28c62354bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:23 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Volume 08bad031-c28f-4ef0-bded-276c5e6e3ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1', 'volume_size': 1}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1788089535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bad031-c28f-4ef0-bded-276c5e6e3ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:23Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Creating volume 08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:23 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:01:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:23 devstack sudo[103082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 1073741824
Jul 31 15:01:23 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:24 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 1073741824" returned: 0 in 0.885s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:24 devstack sudo[103119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1
Jul 31 15:01:24 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:24 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1" returned: 0 in 0.458s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f46052c-0ab6-4d90-9181-d28c62354bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81a8cbb-8d4d-423b-94d7-598066f92d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:24 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Volume volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 (08bad031-c28f-4ef0-bded-276c5e6e3ff1): created successfully
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81a8cbb-8d4d-423b-94d7-598066f92d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (1b21be53-82cd-4ef6-9121-0c4228fd7d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:24 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c9cfff42-f3bd-481b-a1d4-41148d99c03c tempest-VolumesSnapshotTestJSON-912197857 None] Created volume successfully.
Jul 31 15:01:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Creating offline snapshot bf679052-fd36-4c3d-a684-d23ac4ba3e71 of volume 08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:01:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[335439be-65fc-444a-b586-7cfe414a9fb7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:25 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1
Jul 31 15:01:25 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:26 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:26 devstack sudo[103203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 1G
Jul 31 15:01:26 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:26 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 1G" returned: 0 in 0.601s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:26 devstack sudo[103212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71
Jul 31 15:01:26 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:27 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71" returned: 0 in 0.404s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:27 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 is being set with open permissions: ugo+rw
Jul 31 15:01:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:27 devstack sudo[103225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71
Jul 31 15:01:27 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:27 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:27 devstack sudo[103228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.info
Jul 31 15:01:27 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:27 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.info" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:27 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.info is being set with open permissions: ugo+rw
Jul 31 15:01:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:27 devstack sudo[103231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.info
Jul 31 15:01:27 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:28 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.info" returned: 0 in 0.330s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c553e02e-1f02-49a0-ab94-9a6ed42328f1 tempest-VolumesSnapshotTestJSON-912197857 None] Create snapshot completed successfully
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (287ca130-9a0c-46a7-a735-20d1ecb74add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b5736c-9573-4d5a-a686-6fff1ca6ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b5736c-9573-4d5a-a686-6fff1ca6ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449801149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa69a35-aa58-4f17-8b6c-001aeddc8386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:29Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4d5b79-b615-4bc4-a289-fc189b31898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4d5b79-b615-4bc4-a289-fc189b31898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a692b0-e97b-41a4-9c9d-485bb67ad502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a692b0-e97b-41a4-9c9d-485bb67ad502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa69a35-aa58-4f17-8b6c-001aeddc8386', 'volume_name': 'volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b9cedb-fbf3-42d7-8ff0-400932e9ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b9cedb-fbf3-42d7-8ff0-400932e9ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499c40a6-af0f-4df4-b65a-1d6e3282e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Volume 4aa69a35-aa58-4f17-8b6c-001aeddc8386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386', 'volume_size': 1}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449801149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa69a35-aa58-4f17-8b6c-001aeddc8386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:29Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Creating volume 4aa69a35-aa58-4f17-8b6c-001aeddc8386 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:28 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:01:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:28 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386 1073741824
Jul 31 15:01:28 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:29 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386 1073741824" returned: 0 in 0.691s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:29 devstack sudo[103240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386
Jul 31 15:01:29 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (3b232907-e27a-4290-b5e4-076dd34f7ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b64331e-6fbf-454c-bc01-b21f3709c480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b64331e-6fbf-454c-bc01-b21f3709c480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1942071009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf67d3b-05de-44ec-884d-2994a38e031a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bf679052-fd36-4c3d-a684-d23ac4ba3e71,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:30Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0190bd25-d7df-42a9-8e4c-1709d365d778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0190bd25-d7df-42a9-8e4c-1709d365d778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc302f3-d88f-4bf0-b7be-d465ea50be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc302f3-d88f-4bf0-b7be-d465ea50be91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eaf67d3b-05de-44ec-884d-2994a38e031a', 'volume_name': 'volume-eaf67d3b-05de-44ec-884d-2994a38e031a', 'volume_size': 2, 'snapshot_id': 'bf679052-fd36-4c3d-a684-d23ac4ba3e71'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:30 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c7d333-171d-456a-982a-09e2039040c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c7d333-171d-456a-982a-09e2039040c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1de03f-1dc7-4230-ba73-8ec9abda258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Volume eaf67d3b-05de-44ec-884d-2994a38e031a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eaf67d3b-05de-44ec-884d-2994a38e031a', 'volume_size': 2, 'snapshot_id': 'bf679052-fd36-4c3d-a684-d23ac4ba3e71'}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386" returned: 0 in 0.439s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499c40a6-af0f-4df4-b65a-1d6e3282e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984bd246-4325-41a6-988e-b0280aafac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-bf679052-fd36-4c3d-a684-d23ac4ba3e71-eaf67d3b-05de-44ec-884d-2994a38e031a" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Volume volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386 (4aa69a35-aa58-4f17-8b6c-001aeddc8386): created successfully
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984bd246-4325-41a6-988e-b0280aafac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (287ca130-9a0c-46a7-a735-20d1ecb74add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-bf679052-fd36-4c3d-a684-d23ac4ba3e71-eaf67d3b-05de-44ec-884d-2994a38e031a" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Creating volume eaf67d3b-05de-44ec-884d-2994a38e031a from snapshot bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-eaf67d3b-05de-44ec-884d-2994a38e031a" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5cf2c011-dbdd-4c76-ba32-9abbc0b61579 tempest-VolumesActionsTest-506173670 None] Created volume successfully.
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-eaf67d3b-05de-44ec-884d-2994a38e031a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] snapshot: bf679052-fd36-4c3d-a684-d23ac4ba3e71, volume: eaf67d3b-05de-44ec-884d-2994a38e031a,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a46cd-011f-4fb2-b55a-276b5e6fa0b6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:30 devstack sudo[103243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71
Jul 31 15:01:30 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:30 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71" returned: 0 in 0.405s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8250369-9c2a-40c2-b0b5-189fd77dd7de]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:30 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1
Jul 31 15:01:30 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-78320846-06b6-4c10-a6e7-c6fafdd3f7d1 tempest-VolumesActionsTest-506173670 None] Acquiring lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386" by "attach_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-78320846-06b6-4c10-a6e7-c6fafdd3f7d1 tempest-VolumesActionsTest-506173670 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386" acquired by "attach_volume" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-78320846-06b6-4c10-a6e7-c6fafdd3f7d1 tempest-VolumesActionsTest-506173670 None] Attaching volume 4aa69a35-aa58-4f17-8b6c-001aeddc8386 to instance 04fe234e-df36-4074-89fb-d393db813d82 at mountpoint /dev/vdb on host None.
Jul 31 15:01:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-78320846-06b6-4c10-a6e7-c6fafdd3f7d1 tempest-VolumesActionsTest-506173670 None] Attach volume completed successfully.
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-78320846-06b6-4c10-a6e7-c6fafdd3f7d1 tempest-VolumesActionsTest-506173670 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386" released by "attach_volume" :: held 0.109s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:31 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1" returned: 0 in 0.517s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:31 devstack sudo[103253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a
Jul 31 15:01:31 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Flow 'volume_create_manager' (68d773e1-b2de-4769-bb9b-c72a35a3fa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fb5d68-7287-4a6b-ae41-db7d1f2f45f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fb5d68-7287-4a6b-ae41-db7d1f2f45f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-819202055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650cbbc0-353c-4197-840e-0c7712ec1d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd5c0287fb54944803d669f911e6348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9fb47b81-d579-48ff-8286-d20d588619e8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:32Z,use_quota=True,user_id='bdf6725e814f40ebba24480d4b2476d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b544d717-156e-4b86-90f6-fc98c7292abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b544d717-156e-4b86-90f6-fc98c7292abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b1bedd-5572-4ed4-8859-1c2136a770f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b1bedd-5572-4ed4-8859-1c2136a770f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '650cbbc0-353c-4197-840e-0c7712ec1d2a', 'volume_name': 'volume-650cbbc0-353c-4197-840e-0c7712ec1d2a', 'volume_size': 1, 'snapshot_id': '9fb47b81-d579-48ff-8286-d20d588619e8'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d820623-2803-4659-9246-228d3e96a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d820623-2803-4659-9246-228d3e96a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5543c634-4496-4346-b230-d24150b1f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Volume 650cbbc0-353c-4197-840e-0c7712ec1d2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-650cbbc0-353c-4197-840e-0c7712ec1d2a', 'volume_size': 1, 'snapshot_id': '9fb47b81-d579-48ff-8286-d20d588619e8'}
Jul 31 15:01:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bda1ee9c-1f2b-4080-be9a-994432a93c7e tempest-VolumesActionsTest-2046070828 None] Terminate volume connection completed successfully.
Jul 31 15:01:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bda1ee9c-1f2b-4080-be9a-994432a93c7e tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-detach_volume" by "detach_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bda1ee9c-1f2b-4080-be9a-994432a93c7e tempest-VolumesActionsTest-2046070828 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bda1ee9c-1f2b-4080-be9a-994432a93c7e tempest-VolumesActionsTest-2046070828 None] Detaching volume 4aa69a35-aa58-4f17-8b6c-001aeddc8386 from instance 04fe234e-df36-4074-89fb-d393db813d82.
Jul 31 15:01:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bda1ee9c-1f2b-4080-be9a-994432a93c7e tempest-VolumesActionsTest-2046070828 None] Detach volume completed successfully.
Jul 31 15:01:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bda1ee9c-1f2b-4080-be9a-994432a93c7e tempest-VolumesActionsTest-2046070828 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-detach_volume" released by "detach_volume" :: held 0.222s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5987c422-6d74-47a2-8be7-b7e6df8efb19 tempest-VolumesActionsTest-506173670 None] Acquiring lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-detach_volume" by "detach_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5987c422-6d74-47a2-8be7-b7e6df8efb19 tempest-VolumesActionsTest-506173670 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-detach_volume" acquired by "detach_volume" :: waited 0.078s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5987c422-6d74-47a2-8be7-b7e6df8efb19 tempest-VolumesActionsTest-506173670 None] Volume detach called, but volume not attached.
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5987c422-6d74-47a2-8be7-b7e6df8efb19 tempest-VolumesActionsTest-506173670 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Acquiring lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Acquiring lock "cinder-quobyte-4aa69a35-aa58-4f17-8b6c-001aeddc8386" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Lock "cinder-quobyte-4aa69a35-aa58-4f17-8b6c-001aeddc8386" acquired by "delete_volume" :: waited 0.041s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb03000-8faf-4dc8-82ae-43cf3b6fec1c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:34 devstack sudo[103267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386
Jul 31 15:01:34 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:34 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386" returned: 0 in 0.913s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:34 devstack sudo[103275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386
Jul 31 15:01:34 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:35 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4aa69a35-aa58-4f17-8b6c-001aeddc8386" returned: 0 in 0.975s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Lock "cinder-quobyte-4aa69a35-aa58-4f17-8b6c-001aeddc8386" released by "delete_volume" :: held 2.038s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:36 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Created reservations ['90916f0d-9be3-4b64-afa9-220515eacb4e', 'c5e2ea90-d0e0-480e-b522-cf9e9f08e353', 'be4a33b2-11bd-4034-8a4d-74e7f70a9da7', 'ebeeba2a-9afd-4487-9a3c-a8abc79b1a9d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:36 devstack sudo[103278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:01:36 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:37 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 1.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:37 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:01:37 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Deleted volume successfully.
Jul 31 15:01:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ce040e18-1770-4b31-9ec8-c58a442b970c tempest-VolumesActionsTest-506173670 None] Lock "cinder-4aa69a35-aa58-4f17-8b6c-001aeddc8386-delete_volume" released by "delete_volume" :: held 4.295s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:38 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a" returned: 0 in 7.114s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:38 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:01:38 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Converted 1024.00 MB image at 143.93 MB/s
Jul 31 15:01:38 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a is being set with open permissions: ugo+rw
Jul 31 15:01:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:38 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a
Jul 31 15:01:38 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:38 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a" returned: 0 in 0.467s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-eaf67d3b-05de-44ec-884d-2994a38e031a" released by "_copy_volume_from_snapshot" :: held 8.623s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-bf679052-fd36-4c3d-a684-d23ac4ba3e71-eaf67d3b-05de-44ec-884d-2994a38e031a" released by "_create_volume_from_snapshot" :: held 8.805s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.858s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.976s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-quobyte-9fb47b81-d579-48ff-8286-d20d588619e8-650cbbc0-353c-4197-840e-0c7712ec1d2a" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-9fb47b81-d579-48ff-8286-d20d588619e8-650cbbc0-353c-4197-840e-0c7712ec1d2a" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Creating volume 650cbbc0-353c-4197-840e-0c7712ec1d2a from snapshot 9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-quobyte-650cbbc0-353c-4197-840e-0c7712ec1d2a" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1de03f-1dc7-4230-ba73-8ec9abda258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf67d3b-05de-44ec-884d-2994a38e031a', 'volume_size': 2, 'snapshot_id': 'bf679052-fd36-4c3d-a684-d23ac4ba3e71'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e3b512-6ffb-4f3b-b886-1bdfa480e787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-650cbbc0-353c-4197-840e-0c7712ec1d2a" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] snapshot: 9fb47b81-d579-48ff-8286-d20d588619e8, volume: 650cbbc0-353c-4197-840e-0c7712ec1d2a,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 15:01:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Volume volume-eaf67d3b-05de-44ec-884d-2994a38e031a (eaf67d3b-05de-44ec-884d-2994a38e031a): created successfully
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e3b512-6ffb-4f3b-b886-1bdfa480e787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (3b232907-e27a-4290-b5e4-076dd34f7ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-53e292c6-3ec5-4dff-baa1-101ed2c857a1 tempest-VolumesSnapshotTestJSON-912197857 None] Created volume successfully.
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45af65-71a2-4ff1-b448-9b535635a09e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:39 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8
Jul 31 15:01:39 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:39 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8" returned: 0 in 0.587s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e2bbdf-7588-4504-8a92-781655643074]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:40 devstack sudo[103315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3
Jul 31 15:01:40 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:40 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3" returned: 0 in 0.619s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:40 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a
Jul 31 15:01:40 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-eaf67d3b-05de-44ec-884d-2994a38e031a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-eaf67d3b-05de-44ec-884d-2994a38e031a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-eaf67d3b-05de-44ec-884d-2994a38e031a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-eaf67d3b-05de-44ec-884d-2994a38e031a" acquired by "delete_volume" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c4c112-da2a-4bb5-9a70-8e6c605ef535]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:40 devstack sudo[103325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a
Jul 31 15:01:40 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:41 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a" returned: 0 in 0.571s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:41 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a
Jul 31 15:01:41 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:41 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eaf67d3b-05de-44ec-884d-2994a38e031a" returned: 0 in 0.569s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-eaf67d3b-05de-44ec-884d-2994a38e031a" released by "delete_volume" :: held 1.252s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['a8de7ce3-faed-4232-8985-390383efb60b', '533e5c86-ad76-46ec-8d80-525b39dcaf27', '3030cbe7-a395-4cf0-a8e9-816103e21db8', '2f49fa9f-79bd-4277-a8e4-1f4e5e2fff1f'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:42 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:01:42 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (636abb99-e7d9-4d26-86bd-8d1cdd0fa866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10147be1-f594-4c64-8724-0dc0bf0e08eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:43 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10147be1-f594-4c64-8724-0dc0bf0e08eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141846259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5715a16c-5223-482c-9c73-e429067d35f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:43Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862e3644-85e2-4b91-8ed0-596ef3bfbc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862e3644-85e2-4b91-8ed0-596ef3bfbc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04eaf59-d952-47a5-893e-b332b0919d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04eaf59-d952-47a5-893e-b332b0919d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5715a16c-5223-482c-9c73-e429067d35f8', 'volume_name': 'volume-5715a16c-5223-482c-9c73-e429067d35f8', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1ab1e7-48bf-4207-b9f8-bfa4fe04ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1ab1e7-48bf-4207-b9f8-bfa4fe04ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f235617d-d741-4730-a096-ebd7c382d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:43 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Volume 5715a16c-5223-482c-9c73-e429067d35f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5715a16c-5223-482c-9c73-e429067d35f8', 'volume_size': 1}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.726s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:01:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Deleted volume successfully.
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a087739c-47f2-492d-8b57-e402b69265ef tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-eaf67d3b-05de-44ec-884d-2994a38e031a-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-bf679052-fd36-4c3d-a684-d23ac4ba3e71-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-bf679052-fd36-4c3d-a684-d23ac4ba3e71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-08bad031-c28f-4ef0-bded-276c5e6e3ff1" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-08bad031-c28f-4ef0-bded-276c5e6e3ff1" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-bf679052-fd36-4c3d-a684-d23ac4ba3e71" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-bf679052-fd36-4c3d-a684-d23ac4ba3e71" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Deleting offline snapshot bf679052-fd36-4c3d-a684-d23ac4ba3e71 of volume 08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] snapshot_file for this snap is: volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafa80cc-7055-4165-ad03-f05c7b6cf55e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:43 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71
Jul 31 15:01:43 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:44 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71" returned: 0 in 1.105s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:01:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0724b104-e8b4-4f86-be77-d9b5fc4817e8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:44 devstack sudo[103381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1
Jul 31 15:01:44 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1" returned: 0 in 1.127s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:45 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:45 devstack sudo[103387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71
Jul 31 15:01:45 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:46 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71" returned: 0 in 0.878s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:46 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71
Jul 31 15:01:46 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:47 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1.bf679052-fd36-4c3d-a684-d23ac4ba3e71" returned: 0 in 0.828s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:47 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a" returned: 0 in 7.139s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:01:47 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Converted 1024.00 MB image at 143.43 MB/s
Jul 31 15:01:47 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a is being set with open permissions: ugo+rw
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-bf679052-fd36-4c3d-a684-d23ac4ba3e71" released by "_delete_snapshot" :: held 4.219s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:47 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a
Jul 31 15:01:47 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-08bad031-c28f-4ef0-bded-276c5e6e3ff1" released by "delete_snapshot" :: held 4.301s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['0cad372a-14b5-4e5b-bfcb-92e43b649307', 'a581a8c8-b0e5-4169-b14a-9cadc281e743', '71b8528e-ff57-4dd7-8099-25ff57ac2dbe', 'a4c08179-a28b-41a7-b740-fd5c1a52618a'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Delete snapshot completed successfully.
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-93734a35-92c8-4934-9865-b26ea9ceb554 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-bf679052-fd36-4c3d-a684-d23ac4ba3e71-delete_snapshot" released by "delete_snapshot" :: held 4.506s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:47 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-650cbbc0-353c-4197-840e-0c7712ec1d2a" released by "_copy_volume_from_snapshot" :: held 8.805s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-9fb47b81-d579-48ff-8286-d20d588619e8-650cbbc0-353c-4197-840e-0c7712ec1d2a" released by "_create_volume_from_snapshot" :: held 8.907s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.956s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.803s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141846259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5715a16c-5223-482c-9c73-e429067d35f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:43Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Creating volume 5715a16c-5223-482c-9c73-e429067d35f8 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:47 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:01:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:48 devstack sudo[103458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8 1073741824
Jul 31 15:01:48 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5543c634-4496-4346-b230-d24150b1f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650cbbc0-353c-4197-840e-0c7712ec1d2a', 'volume_size': 1, 'snapshot_id': '9fb47b81-d579-48ff-8286-d20d588619e8'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acbf0df-108f-4cb8-a28a-7850296d411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Volume volume-650cbbc0-353c-4197-840e-0c7712ec1d2a (650cbbc0-353c-4197-840e-0c7712ec1d2a): created successfully
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acbf0df-108f-4cb8-a28a-7850296d411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Flow 'volume_create_manager' (68d773e1-b2de-4769-bb9b-c72a35a3fa37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b0bd3e16-6ebc-429f-8087-fde99023679a tempest-TestStampPattern-920762642 None] Created volume successfully.
Jul 31 15:01:48 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8 1073741824" returned: 0 in 0.442s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:48 devstack sudo[103465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8
Jul 31 15:01:48 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:48 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8" returned: 0 in 0.281s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f235617d-d741-4730-a096-ebd7c382d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5715a16c-5223-482c-9c73-e429067d35f8', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d690a0d-0329-4cdc-8490-67c5b0525cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Volume volume-5715a16c-5223-482c-9c73-e429067d35f8 (5715a16c-5223-482c-9c73-e429067d35f8): created successfully
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d690a0d-0329-4cdc-8490-67c5b0525cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (636abb99-e7d9-4d26-86bd-8d1cdd0fa866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6b5e0a5a-ff3e-40bc-bf20-4c24cd72ceee tempest-VolumesActionsTest-506173670 None] Created volume successfully.
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-08bad031-c28f-4ef0-bded-276c5e6e3ff1-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-08bad031-c28f-4ef0-bded-276c5e6e3ff1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-08bad031-c28f-4ef0-bded-276c5e6e3ff1" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-08bad031-c28f-4ef0-bded-276c5e6e3ff1" acquired by "delete_volume" :: waited 0.032s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9114f93a-41f2-4dcd-844a-94556b4a1215]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:49 devstack sudo[103472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1
Jul 31 15:01:49 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-5715a16c-5223-482c-9c73-e429067d35f8-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-5715a16c-5223-482c-9c73-e429067d35f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-quobyte-5715a16c-5223-482c-9c73-e429067d35f8" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-5715a16c-5223-482c-9c73-e429067d35f8" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c6e099-04ac-42dc-8d7d-e83378d3333c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:49 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1" returned: 0 in 0.506s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:49 devstack sudo[103479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1
Jul 31 15:01:49 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:49 devstack sudo[103478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8
Jul 31 15:01:49 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:49 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-08bad031-c28f-4ef0-bded-276c5e6e3ff1" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-08bad031-c28f-4ef0-bded-276c5e6e3ff1" released by "delete_volume" :: held 0.875s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['5cb9a963-2138-405e-b7a0-98c139cbee49', '4e0f2ae2-8b46-4fa5-b3fa-7109cd93c7d6', '4389138e-2bfe-43a9-acc7-bb69933427a8', 'ceed5087-d5ac-4c7f-b310-e50677bca4ca'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:50 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8" returned: 0 in 0.488s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:50 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8
Jul 31 15:01:50 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:50 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:01:50 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:50 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5715a16c-5223-482c-9c73-e429067d35f8" returned: 0 in 0.354s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-5715a16c-5223-482c-9c73-e429067d35f8" released by "delete_volume" :: held 0.899s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:50 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.326s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Created reservations ['2f6ca1dd-b6b2-4e39-95c0-27be6a40f0d7', 'a7097728-6f8f-433e-9378-b19e506247e4', '00c3cfd8-f523-4683-aa57-0039f6a8233d', 'e1ed5509-1232-4dd0-aeca-6d14f19a78fc'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Deleted volume successfully.
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8ba4311e-46c0-4456-b442-bf0f3a334c29 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-08bad031-c28f-4ef0-bded-276c5e6e3ff1-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:50 devstack sudo[103492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:01:50 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:50 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:01:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Deleted volume successfully.
Jul 31 15:01:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3a1bf88f-0bf2-4d90-9d1a-5ba894d7de64 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-5715a16c-5223-482c-9c73-e429067d35f8-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (c1d5abff-02fa-44e9-9ea9-d5434412b605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbd0073-d829-473c-a0eb-1115a1855266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbd0073-d829-473c-a0eb-1115a1855266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605985986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282c4dbb-4458-4333-b4f9-948a0f0c32b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:52Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dff5c2b-7793-4001-8e10-b5e9187758bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dff5c2b-7793-4001-8e10-b5e9187758bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c86ac1-fa39-4f82-b4a9-e958a4c1bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c86ac1-fa39-4f82-b4a9-e958a4c1bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282c4dbb-4458-4333-b4f9-948a0f0c32b6', 'volume_name': 'volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d5da5f-388a-496e-be10-86b77ac650ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d5da5f-388a-496e-be10-86b77ac650ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99d08be-6762-4bf7-a1b2-cf2bc20b42cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:52 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Volume 282c4dbb-4458-4333-b4f9-948a0f0c32b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6', 'volume_size': 1}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605985986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282c4dbb-4458-4333-b4f9-948a0f0c32b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:52Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Creating volume 282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:52 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:52 devstack sudo[103495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 1073741824
Jul 31 15:01:52 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (f42a73b5-e793-4293-a6c4-d2f10c4f420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf609522-0723-43fd-a67d-88e34b27ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf609522-0723-43fd-a67d-88e34b27ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1485145213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c893de8-13fd-4150-b247-c8ce8bf84c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:52Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a5ad15-6781-460f-9448-4d003f1acbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a5ad15-6781-460f-9448-4d003f1acbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7aaaba-7492-47f1-9a9b-b33483cf0e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7aaaba-7492-47f1-9a9b-b33483cf0e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c893de8-13fd-4150-b247-c8ce8bf84c86', 'volume_name': 'volume-1c893de8-13fd-4150-b247-c8ce8bf84c86', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ac11b9-7724-47c6-a71c-cbe737db1d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ac11b9-7724-47c6-a71c-cbe737db1d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5582f56e-2095-414e-b578-a988ddd4952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:52 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Volume 1c893de8-13fd-4150-b247-c8ce8bf84c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c893de8-13fd-4150-b247-c8ce8bf84c86', 'volume_size': 1}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:52 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 1073741824" returned: 0 in 0.685s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:52 devstack sudo[103504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6
Jul 31 15:01:52 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:53 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1485145213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c893de8-13fd-4150-b247-c8ce8bf84c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:52Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Creating volume 1c893de8-13fd-4150-b247-c8ce8bf84c86 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:53 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99d08be-6762-4bf7-a1b2-cf2bc20b42cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:53 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86 1073741824
Jul 31 15:01:53 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10d1d29-029a-465d-a5b7-9f68bdb8cf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:53 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Volume volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 (282c4dbb-4458-4333-b4f9-948a0f0c32b6): created successfully
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10d1d29-029a-465d-a5b7-9f68bdb8cf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (c1d5abff-02fa-44e9-9ea9-d5434412b605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c04e5b9e-2beb-485f-a481-87dc42b74e23 tempest-VolumesSnapshotTestJSON-912197857 None] Created volume successfully.
Jul 31 15:01:53 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86 1073741824" returned: 0 in 0.484s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:53 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86
Jul 31 15:01:53 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:53 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86" returned: 0 in 0.265s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5582f56e-2095-414e-b578-a988ddd4952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c893de8-13fd-4150-b247-c8ce8bf84c86', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9f9b0e-8884-44d9-96e3-406acf327de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:53 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Volume volume-1c893de8-13fd-4150-b247-c8ce8bf84c86 (1c893de8-13fd-4150-b247-c8ce8bf84c86): created successfully
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9f9b0e-8884-44d9-96e3-406acf327de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (f42a73b5-e793-4293-a6c4-d2f10c4f420b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1cc2ce14-22b8-4286-8dfa-5253e56d2272 tempest-VolumesActionsTest-506173670 None] Created volume successfully.
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Creating offline snapshot 0e3ecd07-7381-43d7-bad6-956cd9d64456 of volume 282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[940043dc-47ac-4aeb-914e-d4b5cefeff26]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:54 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6
Jul 31 15:01:54 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:54 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6" returned: 0 in 0.376s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:54 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 1G
Jul 31 15:01:54 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-1c893de8-13fd-4150-b247-c8ce8bf84c86-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-1c893de8-13fd-4150-b247-c8ce8bf84c86-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-quobyte-1c893de8-13fd-4150-b247-c8ce8bf84c86" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-1c893de8-13fd-4150-b247-c8ce8bf84c86" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0f1776-c762-41f2-9ca4-089d2360b762]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:55 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 1G" returned: 0 in 0.460s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:55 devstack sudo[103528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456
Jul 31 15:01:55 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:55 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86
Jul 31 15:01:55 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:55 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86" returned: 0 in 0.399s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:55 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456" returned: 0 in 0.326s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:55 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 is being set with open permissions: ugo+rw
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:55 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86
Jul 31 15:01:55 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:55 devstack sudo[103539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456
Jul 31 15:01:55 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:55 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456" returned: 0 in 0.245s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:55 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1c893de8-13fd-4150-b247-c8ce8bf84c86" returned: 0 in 0.269s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-1c893de8-13fd-4150-b247-c8ce8bf84c86" released by "delete_volume" :: held 0.714s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:55 devstack sudo[103544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.info
Jul 31 15:01:55 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Created reservations ['2090441c-33e4-46dc-9833-6f1b9570acf2', 'c3b6fa16-3fb4-4cbe-900d-27445d181366', '4ba49e22-a26d-4a98-b4c9-361b9503f29d', '8c78e4cd-eb4a-4b87-a75d-7eb2785bd930'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:55 devstack sudo[103546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:01:55 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:55 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.info" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:55 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.info is being set with open permissions: ugo+rw
Jul 31 15:01:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:55 devstack sudo[103549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.info
Jul 31 15:01:55 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:56 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.275s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:01:56 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Deleted volume successfully.
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-183a1004-1da7-49b5-bd41-c2fac79e6768 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-1c893de8-13fd-4150-b247-c8ce8bf84c86-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:56 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.info" returned: 0 in 0.306s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:56 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5bfeecf9-8bfc-4062-9268-80e5253b2f2a tempest-VolumesSnapshotTestJSON-912197857 None] Create snapshot completed successfully
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (313ca536-e593-4569-a0ec-45c230ca0224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43034b8-86e1-4b77-8c46-68a4e3e8aed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43034b8-86e1-4b77-8c46-68a4e3e8aed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700172367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:57Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7b8638-dcbf-40e5-8b4e-a9800cb0ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7b8638-dcbf-40e5-8b4e-a9800cb0ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634061b8-2218-4b9e-ab32-88cd26eec742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634061b8-2218-4b9e-ab32-88cd26eec742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7', 'volume_name': 'volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b7d39b-9b68-4914-a299-d7a80e6d349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b7d39b-9b68-4914-a299-d7a80e6d349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f68ad64-7b6a-4e71-a730-f342f717599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:56 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Volume d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7', 'volume_size': 1}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700172367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:57Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Creating volume d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:56 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:01:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:56 devstack sudo[103553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 1073741824
Jul 31 15:01:56 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:57 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 1073741824" returned: 0 in 0.429s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:57 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7
Jul 31 15:01:57 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:57 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f68ad64-7b6a-4e71-a730-f342f717599d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b153df47-08ae-4a4f-bcfc-9f064af5dabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Volume volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 (d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7): created successfully
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b153df47-08ae-4a4f-bcfc-9f064af5dabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (313ca536-e593-4569-a0ec-45c230ca0224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ef98d22a-bcc0-4807-ad53-036adccd85dc tempest-VolumesActionsTest-506173670 None] Created volume successfully.
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Lock "cinder-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-quobyte-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[352ed84c-d509-4b1f-ab34-f522a4ec5430]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:58 devstack sudo[103561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7
Jul 31 15:01:58 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:58 devstack sudo[103562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:01:58 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (17931b48-e074-42ec-a61e-e472db0245c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981694d4-632c-403e-8f28-7b960485cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981694d4-632c-403e-8f28-7b960485cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1598100235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53342569-cd7c-443b-b9b1-425ebd02e6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ee1d7929f433b9959ddc7c58e4242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e3ecd07-7381-43d7-bad6-956cd9d64456,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:58Z,use_quota=True,user_id='6d73be033a604289adc3bab9e0e04311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9702b717-d670-4f5b-b18e-1792dc5ece03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9702b717-d670-4f5b-b18e-1792dc5ece03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c196ef2d-b44b-4f0c-abcb-43387f3f04f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c196ef2d-b44b-4f0c-abcb-43387f3f04f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53342569-cd7c-443b-b9b1-425ebd02e6b0', 'volume_name': 'volume-53342569-cd7c-443b-b9b1-425ebd02e6b0', 'volume_size': 1, 'snapshot_id': '0e3ecd07-7381-43d7-bad6-956cd9d64456'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934bfe9a-d77b-4b4d-8419-804cf35c58a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934bfe9a-d77b-4b4d-8419-804cf35c58a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5178ac-a0d2-4284-a90c-8d8fe436ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:58 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Volume 53342569-cd7c-443b-b9b1-425ebd02e6b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53342569-cd7c-443b-b9b1-425ebd02e6b0', 'volume_size': 1, 'snapshot_id': '0e3ecd07-7381-43d7-bad6-956cd9d64456'}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-0e3ecd07-7381-43d7-bad6-956cd9d64456-53342569-cd7c-443b-b9b1-425ebd02e6b0" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-0e3ecd07-7381-43d7-bad6-956cd9d64456-53342569-cd7c-443b-b9b1-425ebd02e6b0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Creating volume 53342569-cd7c-443b-b9b1-425ebd02e6b0 from snapshot 0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-53342569-cd7c-443b-b9b1-425ebd02e6b0" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:01:58 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7" returned: 0 in 0.406s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-53342569-cd7c-443b-b9b1-425ebd02e6b0" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] snapshot: 0e3ecd07-7381-43d7-bad6-956cd9d64456, volume: 53342569-cd7c-443b-b9b1-425ebd02e6b0,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 15:01:58 devstack sudo[103569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7
Jul 31 15:01:58 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:58 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.399s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[817cf6f4-5ea0-45cc-a9f3-7462260502b0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:58 devstack sudo[103572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456
Jul 31 15:01:58 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:58 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7" released by "delete_volume" :: held 0.749s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Created reservations ['f2d7112a-e099-4161-9916-af949163e71f', 'bfd9f5d8-5c25-4c05-854b-c63d57f627cb', 'b11e51a2-7ac2-4bfc-a86d-12483b1e44ef', '2a7f4921-aefc-443d-a396-931a6c285e15'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:58 devstack sudo[103577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:01:58 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:58 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456" returned: 0 in 0.401s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3fbee1-11ee-4df9-a579-2fdfa98a6cbe]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:01:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:59 devstack sudo[103580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6
Jul 31 15:01:59 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:59 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:01:59 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Deleted volume successfully.
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a7ee05b-b976-4c24-976b-1d31c111989b tempest-VolumesActionsTest-2046070828 None] Lock "cinder-d5f0e5a9-cc2d-4197-88b7-b523a4b7d3a7-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:01:59 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6" returned: 0 in 0.444s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:01:59 devstack sudo[103587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0
Jul 31 15:01:59 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (fcd3ca59-9884-4524-9b39-6c3dc6dff3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a3f252-b31b-4c05-8356-3c0f7b52246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a3f252-b31b-4c05-8356-3c0f7b52246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1940172529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab34ea7-90d5-4da0-9ddb-8282333da839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:59Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5e8509-9796-4997-9bd4-e019cdcb17ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5e8509-9796-4997-9bd4-e019cdcb17ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3217d1ed-273a-47a1-90e2-d467ffa9941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3217d1ed-273a-47a1-90e2-d467ffa9941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab34ea7-90d5-4da0-9ddb-8282333da839', 'volume_name': 'volume-3ab34ea7-90d5-4da0-9ddb-8282333da839', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752b5c02-530c-4135-b70d-c13cbd1da814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752b5c02-530c-4135-b70d-c13cbd1da814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e923dc9d-8401-4537-87f0-a03378253176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:01:59 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Volume 3ab34ea7-90d5-4da0-9ddb-8282333da839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab34ea7-90d5-4da0-9ddb-8282333da839', 'volume_size': 1}
Jul 31 15:01:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:03 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0" returned: 0 in 4.618s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:03 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:02:03 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Converted 1024.00 MB image at 221.68 MB/s
Jul 31 15:02:03 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 is being set with open permissions: ugo+rw
Jul 31 15:02:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:03 devstack sudo[103607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0
Jul 31 15:02:03 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:04 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0" returned: 0 in 0.241s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-53342569-cd7c-443b-b9b1-425ebd02e6b0" released by "_copy_volume_from_snapshot" :: held 5.835s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-0e3ecd07-7381-43d7-bad6-956cd9d64456-53342569-cd7c-443b-b9b1-425ebd02e6b0" released by "_create_volume_from_snapshot" :: held 5.914s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.934s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.596s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1940172529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab34ea7-90d5-4da0-9ddb-8282333da839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:01:59Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Creating volume 3ab34ea7-90d5-4da0-9ddb-8282333da839 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:02:04 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:04 devstack sudo[103610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839 1073741824
Jul 31 15:02:04 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5178ac-a0d2-4284-a90c-8d8fe436ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53342569-cd7c-443b-b9b1-425ebd02e6b0', 'volume_size': 1, 'snapshot_id': '0e3ecd07-7381-43d7-bad6-956cd9d64456'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5310e124-6704-4a04-bb3a-c35443bb4837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:04 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Volume volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 (53342569-cd7c-443b-b9b1-425ebd02e6b0): created successfully
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5310e124-6704-4a04-bb3a-c35443bb4837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Flow 'volume_create_manager' (17931b48-e074-42ec-a61e-e472db0245c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5f0dfbdd-fae4-4ea6-b043-acefe1d9f511 tempest-VolumesSnapshotTestJSON-912197857 None] Created volume successfully.
Jul 31 15:02:04 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839 1073741824" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-53342569-cd7c-443b-b9b1-425ebd02e6b0-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:04 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839
Jul 31 15:02:04 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-53342569-cd7c-443b-b9b1-425ebd02e6b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-53342569-cd7c-443b-b9b1-425ebd02e6b0" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-53342569-cd7c-443b-b9b1-425ebd02e6b0" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0372617d-504a-43c8-bf6c-2e1892ddaa02]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:04 devstack sudo[103618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0
Jul 31 15:02:04 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:04 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839" returned: 0 in 0.249s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e923dc9d-8401-4537-87f0-a03378253176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab34ea7-90d5-4da0-9ddb-8282333da839', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8013a449-72de-4f75-ac72-c18a77968f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:04 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Volume volume-3ab34ea7-90d5-4da0-9ddb-8282333da839 (3ab34ea7-90d5-4da0-9ddb-8282333da839): created successfully
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8013a449-72de-4f75-ac72-c18a77968f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (fcd3ca59-9884-4524-9b39-6c3dc6dff3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e49eb968-b026-48ef-9174-d3c080284691 tempest-VolumesActionsTest-506173670 None] Created volume successfully.
Jul 31 15:02:05 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0" returned: 0 in 0.363s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:05 devstack sudo[103625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0
Jul 31 15:02:05 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:05 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-53342569-cd7c-443b-b9b1-425ebd02e6b0" returned: 0 in 0.235s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-53342569-cd7c-443b-b9b1-425ebd02e6b0" released by "delete_volume" :: held 0.640s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['92275234-0cf5-4e7f-a571-1d4faad102ee', 'b0886b78-cd6e-456e-94dc-6bec1052713f', '3ab191b9-558d-449f-b316-c4e32600f29b', '83bddc1e-0c96-42d8-83d0-5e844dd7703e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:05 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:05 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:05 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.235s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:05 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Deleted volume successfully.
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-cc066072-fdb1-4adb-8db8-88ea9f40f592 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-53342569-cd7c-443b-b9b1-425ebd02e6b0-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-0e3ecd07-7381-43d7-bad6-956cd9d64456-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-0e3ecd07-7381-43d7-bad6-956cd9d64456-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-282c4dbb-4458-4333-b4f9-948a0f0c32b6" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-282c4dbb-4458-4333-b4f9-948a0f0c32b6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-0e3ecd07-7381-43d7-bad6-956cd9d64456" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-0e3ecd07-7381-43d7-bad6-956cd9d64456" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Deleting offline snapshot 0e3ecd07-7381-43d7-bad6-956cd9d64456 of volume 282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] snapshot_file for this snap is: volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[278f4ac8-733c-4daf-815d-c084404b68f1]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:06 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456
Jul 31 15:02:06 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-3ab34ea7-90d5-4da0-9ddb-8282333da839-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-3ab34ea7-90d5-4da0-9ddb-8282333da839-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "cinder-quobyte-3ab34ea7-90d5-4da0-9ddb-8282333da839" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-3ab34ea7-90d5-4da0-9ddb-8282333da839" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d4c34f-7de3-43f5-a35d-e11b056f1411]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:06 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456" returned: 0 in 0.370s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa7d63e-66be-474c-ae0c-e0a8418817c3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:06 devstack sudo[103636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839
Jul 31 15:02:06 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:06 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6
Jul 31 15:02:06 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:06 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839" returned: 0 in 0.353s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:06 devstack sudo[103645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839
Jul 31 15:02:06 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:06 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6" returned: 0 in 0.537s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:06 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3ab34ea7-90d5-4da0-9ddb-8282333da839" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:06 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456
Jul 31 15:02:06 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-quobyte-3ab34ea7-90d5-4da0-9ddb-8282333da839" released by "delete_volume" :: held 0.652s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:06 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Created reservations ['941bb2e0-9de3-408e-b91f-b48196f51290', '371aa7f1-1317-406c-866f-989cea987630', '3a11cf71-f1d7-4d5b-bdab-b4fe2d8d165b', '66fdae25-5170-4f90-b4f5-f8de9c331715'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:07 devstack sudo[103651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:07 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:07 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456" returned: 0 in 0.345s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:07 devstack sudo[103656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456
Jul 31 15:02:07 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:07 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.260s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:07 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Deleted volume successfully.
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c126c279-624e-428f-91d7-191aa13cf7a9 tempest-VolumesActionsTest-2046070828 None] Lock "cinder-3ab34ea7-90d5-4da0-9ddb-8282333da839-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:07 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6.0e3ecd07-7381-43d7-bad6-956cd9d64456" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-0e3ecd07-7381-43d7-bad6-956cd9d64456" released by "_delete_snapshot" :: held 1.617s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-282c4dbb-4458-4333-b4f9-948a0f0c32b6" released by "delete_snapshot" :: held 1.642s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=118,cinder:UPDATE=111,cinder:INSERT=29,cinder:DELETE=7 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['87863f49-833e-4ae2-898e-dd354ecb0fd5', 'b6d927ba-bec4-4229-b756-1dfae9024c62', '189563d4-5bf9-44b0-a2c4-053524b3bf9c', '0c970f4b-824e-486a-8bdf-108e8383f162'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:07 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Delete snapshot completed successfully.
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7c5d1377-e542-4cc2-9f3e-9fb50582b490 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-0e3ecd07-7381-43d7-bad6-956cd9d64456-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (5050ab5e-77ad-4fd6-b918-933d0201e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a8aead-a8d6-4592-9b19-d2884a24a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a8aead-a8d6-4592-9b19-d2884a24a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226496089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0161f944-1dba-4e64-9f19-c5324873892b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:08Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9a2d03-08de-4b95-a21b-6b685feba8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9a2d03-08de-4b95-a21b-6b685feba8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309c314b-64a1-4cde-bbdb-91c32170872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309c314b-64a1-4cde-bbdb-91c32170872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0161f944-1dba-4e64-9f19-c5324873892b', 'volume_name': 'volume-0161f944-1dba-4e64-9f19-c5324873892b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d703d62d-659b-480d-8393-84d53903d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d703d62d-659b-480d-8393-84d53903d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef5444-4192-4503-8f96-7c4d675c42eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:08 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Volume 0161f944-1dba-4e64-9f19-c5324873892b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0161f944-1dba-4e64-9f19-c5324873892b', 'volume_size': 1}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226496089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0161f944-1dba-4e64-9f19-c5324873892b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61064c91492c447781e60e5c4a32c02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:08Z,use_quota=True,user_id='0f16f99a62c348568c4474c1dd4f3b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Creating volume 0161f944-1dba-4e64-9f19-c5324873892b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:02:08 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:08 devstack sudo[103668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b 1073741824
Jul 31 15:02:08 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-282c4dbb-4458-4333-b4f9-948a0f0c32b6-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-282c4dbb-4458-4333-b4f9-948a0f0c32b6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=117,cinder:UPDATE=136,cinder:INSERT=29,cinder:DELETE=16 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-282c4dbb-4458-4333-b4f9-948a0f0c32b6" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-282c4dbb-4458-4333-b4f9-948a0f0c32b6" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cef893a-1708-4107-a52d-3910a9abba52]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:08 devstack sudo[103676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6
Jul 31 15:02:08 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:08 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b 1073741824" returned: 0 in 0.485s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:08 devstack sudo[103682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b
Jul 31 15:02:08 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:08 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6" returned: 0 in 0.406s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:08 devstack sudo[103687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6
Jul 31 15:02:08 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:08 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b" returned: 0 in 0.273s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef5444-4192-4503-8f96-7c4d675c42eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0161f944-1dba-4e64-9f19-c5324873892b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b37cc3-57cb-4bba-8c66-894948e4c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:08 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Volume volume-0161f944-1dba-4e64-9f19-c5324873892b (0161f944-1dba-4e64-9f19-c5324873892b): created successfully
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b37cc3-57cb-4bba-8c66-894948e4c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Flow 'volume_create_manager' (5050ab5e-77ad-4fd6-b918-933d0201e957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:08 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d70a5df8-310b-49e3-9327-fe360677ad41 tempest-VolumesActionsTest-506173670 None] Created volume successfully.
Jul 31 15:02:08 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-282c4dbb-4458-4333-b4f9-948a0f0c32b6" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-282c4dbb-4458-4333-b4f9-948a0f0c32b6" released by "delete_volume" :: held 0.722s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['2549ac6c-45ad-498c-950a-72828af8e085', '492d1cac-1815-4be2-a42a-9009c9d15782', 'c022b23c-e6fe-457d-901a-9463297b59ae', '92117c4b-a265-43fe-ba6a-fab653196634'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:09 devstack sudo[103691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:09 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:09 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.249s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Deleted volume successfully.
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4b938020-d096-442f-bd24-e00b82ddfe30 tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-282c4dbb-4458-4333-b4f9-948a0f0c32b6-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "cinder-quobyte-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec32329-780d-4f3c-9ae7-586b0ded75b4]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:09 devstack sudo[103694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63
Jul 31 15:02:09 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:09 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" returned: 0 in 0.342s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:09 devstack sudo[103699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63
Jul 31 15:02:09 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:10 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" returned: 0 in 0.245s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-quobyte-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63" released by "delete_volume" :: held 0.645s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Created reservations ['dd192bb9-02d6-423b-939a-d7ec004fc495', 'b1041e97-6a44-414c-984d-fe6c2e2b5fe4', '0a706d39-b48d-46bf-a15c-0819de2b3ddd', '5e2528fa-8579-4f2b-9419-1efc6b90aeda'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:10 devstack sudo[103702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:10 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:10 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Deleted volume successfully.
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-42ec00e2-1df2-49df-b7cf-cbfa409f47fa tempest-VolumesSnapshotTestJSON-912197857 None] Lock "cinder-a9c07c0c-b6c4-4944-a0c9-0127f2d86a63-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Acquiring lock "cinder-0161f944-1dba-4e64-9f19-c5324873892b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Lock "cinder-0161f944-1dba-4e64-9f19-c5324873892b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Acquiring lock "cinder-quobyte-0161f944-1dba-4e64-9f19-c5324873892b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Lock "cinder-quobyte-0161f944-1dba-4e64-9f19-c5324873892b" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b306c4-0313-4ad3-aa36-7434d55bfceb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:10 devstack sudo[103705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b
Jul 31 15:02:10 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:11 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b" returned: 0 in 0.368s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:11 devstack sudo[103710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b
Jul 31 15:02:11 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:11 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0161f944-1dba-4e64-9f19-c5324873892b" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Lock "cinder-quobyte-0161f944-1dba-4e64-9f19-c5324873892b" released by "delete_volume" :: held 0.684s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Created reservations ['f3c7d997-f534-46ed-b530-c05c52d3fba3', '4b29f640-d9fe-40aa-8bd0-a63abf729f25', '52d46e97-edda-4270-bcfa-2603be569120', 'ec75f761-3102-492b-bb7c-3ba6d8e14424'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:11 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:11 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:11 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Deleted volume successfully.
Jul 31 15:02:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80dada38-1648-41b5-951d-54990b94836b tempest-VolumesActionsTest-506173670 None] Lock "cinder-0161f944-1dba-4e64-9f19-c5324873892b-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:21 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:02:21 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=16,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Flow 'volume_create_manager' (025c5141-5f7d-4bd7-bb36-0c832269b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382c6d0-6a28-4efd-9219-e7a9e2b457d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382c6d0-6a28-4efd-9219-e7a9e2b457d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1986274376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3e7572-9025-4064-ad7c-b52ee91aeedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6d4671c0864b8190f51deb645ccd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:24Z,use_quota=True,user_id='69e539d0f00146de8b4e20f8bb808cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcb4288-13e7-411c-af35-42978b7d978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcb4288-13e7-411c-af35-42978b7d978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6672cf42-2135-4a86-a736-c04b87246d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6672cf42-2135-4a86-a736-c04b87246d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd3e7572-9025-4064-ad7c-b52ee91aeedd', 'volume_name': 'volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda52bfb0>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0249936-d07e-4e49-ab2e-87bb530ed213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0249936-d07e-4e49-ab2e-87bb530ed213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddf2ca9-fdb2-4e38-8874-a0a67484ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:24 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Volume dd3e7572-9025-4064-ad7c-b52ee91aeedd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda52bfb0>}
Jul 31 15:02:24 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Trying to clone dd3e7572-9025-4064-ad7c-b52ee91aeedd from image 6ede671b-18a7-43c3-97de-ba07f3408159 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:02:25 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Image download 20.69 MB at 20.69 MB/s
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[03703d7b-4f48-4425-ac4d-1ffc3f9cb267]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:25 devstack sudo[103762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD
Jul 31 15:02:25 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:25 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 is fetched for user 69e539d0f00146de8b4e20f8bb808cfd. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9925308a-c459-43bc-95c1-b3b413ff921a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:25 devstack sudo[103767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD
Jul 31 15:02:25 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:25 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1986274376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3e7572-9025-4064-ad7c-b52ee91aeedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6d4671c0864b8190f51deb645ccd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:24Z,use_quota=True,user_id='69e539d0f00146de8b4e20f8bb808cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Creating volume dd3e7572-9025-4064-ad7c-b52ee91aeedd {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:02:25 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:02:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:25 devstack sudo[103775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd 1073741824
Jul 31 15:02:25 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:26 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd 1073741824" returned: 0 in 0.463s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:26 devstack sudo[103784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd
Jul 31 15:02:26 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:26 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd" returned: 0 in 0.322s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Attempting download of 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume dd3e7572-9025-4064-ad7c-b52ee91aeedd. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a64ea9-00d8-482f-b8d0-2d2d8e17ebc7]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_0r7nczjl {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:27 devstack sudo[103787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_0r7nczjl
Jul 31 15:02:27 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:27 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_0r7nczjl" returned: 0 in 0.365s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_0r7nczjl {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:27 devstack sudo[103791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_0r7nczjl
Jul 31 15:02:27 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:27 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_0r7nczjl" returned: 1 in 0.328s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_0r7nczjl' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec952300-e26c-42a9-9870-f05c42bb4f5c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:27 devstack sudo[103795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD
Jul 31 15:02:27 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:27 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] 6ede671b-18a7-43c3-97de-ba07f3408159 was qcow2, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:02:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:27 devstack sudo[103800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd
Jul 31 15:02:27 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:29 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd" returned: 0 in 1.906s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:29 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_1wesc2twdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:02:29 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Converted 112.00 MB image at 58.72 MB/s
Jul 31 15:02:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:29 devstack sudo[103814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd 1G
Jul 31 15:02:29 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:30 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd 1G" returned: 0 in 0.427s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Downloaded image 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume dd3e7572-9025-4064-ad7c-b52ee91aeedd successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 for user 69e539d0f00146de8b4e20f8bb808cfd is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Marking volume dd3e7572-9025-4064-ad7c-b52ee91aeedd as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Copying metadata from image 6ede671b-18a7-43c3-97de-ba07f3408159 to dd3e7572-9025-4064-ad7c-b52ee91aeedd. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Creating volume glance metadata for volume dd3e7572-9025-4064-ad7c-b52ee91aeedd backed by image 6ede671b-18a7-43c3-97de-ba07f3408159 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddf2ca9-fdb2-4e38-8874-a0a67484ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda52bfb0>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7220e2a1-0c7c-4ef1-be05-9c8b48ab94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Volume volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd (dd3e7572-9025-4064-ad7c-b52ee91aeedd): created successfully
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7220e2a1-0c7c-4ef1-be05-9c8b48ab94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Flow 'volume_create_manager' (025c5141-5f7d-4bd7-bb36-0c832269b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-78f16c20-b7c1-4420-8b77-b99ba8c23aea tempest-VolumesImageMetadata-1365538318 None] Created volume successfully.
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-73a54a6d-68b7-47f9-9e62-763f0b6955a2 req-a9223f30-4f60-4373-b68c-6652729fc88e tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-73a54a6d-68b7-47f9-9e62-763f0b6955a2 req-a9223f30-4f60-4373-b68c-6652729fc88e tempest-TestStampPattern-920762642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-73a54a6d-68b7-47f9-9e62-763f0b6955a2 req-a9223f30-4f60-4373-b68c-6652729fc88e tempest-TestStampPattern-920762642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-73a54a6d-68b7-47f9-9e62-763f0b6955a2 req-a9223f30-4f60-4373-b68c-6652729fc88e tempest-TestStampPattern-920762642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-650cbbc0-353c-4197-840e-0c7712ec1d2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c33a0df5-9ab9-4ee5-90ff-a9a0ccf82823', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 15:02:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-73a54a6d-68b7-47f9-9e62-763f0b6955a2 req-a9223f30-4f60-4373-b68c-6652729fc88e tempest-TestStampPattern-920762642 None] attachment_update completed successfully.
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Acquiring lock "cinder-dd3e7572-9025-4064-ad7c-b52ee91aeedd-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Lock "cinder-dd3e7572-9025-4064-ad7c-b52ee91aeedd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Acquiring lock "cinder-quobyte-dd3e7572-9025-4064-ad7c-b52ee91aeedd" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Lock "cinder-quobyte-dd3e7572-9025-4064-ad7c-b52ee91aeedd" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d02da3-b138-4294-9d51-eb05e6e04bce]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:31 devstack sudo[104212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd
Jul 31 15:02:31 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:31 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd" returned: 0 in 0.484s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:31 devstack sudo[104217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd
Jul 31 15:02:31 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:31 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-dd3e7572-9025-4064-ad7c-b52ee91aeedd" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Lock "cinder-quobyte-dd3e7572-9025-4064-ad7c-b52ee91aeedd" released by "delete_volume" :: held 0.799s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Created reservations ['f5aabc9a-4e57-490d-8da0-000eca7acb5e', 'cba4d8fa-5862-4f27-a225-34a5849c9b9d', '0a33112a-99fc-42e4-8d85-2d8c1e2c40ea', '250d02e2-ce98-4b34-ae76-05b5b5b3370d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:32 devstack sudo[104220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:32 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:32 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Deleted volume successfully.
Jul 31 15:02:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c356353f-f0de-4a8b-bf27-f9ec026999a2 tempest-VolumesImageMetadata-1365538318 None] Lock "cinder-dd3e7572-9025-4064-ad7c-b52ee91aeedd-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-82b2da78-ff7f-4392-804c-57dcc9e40646 req-8309352b-cfbb-4500-b530-5b3d7cee85e9 tempest-TestStampPattern-920762642 None] Terminate volume connection completed successfully.
Jul 31 15:02:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-82b2da78-ff7f-4392-804c-57dcc9e40646 req-8309352b-cfbb-4500-b530-5b3d7cee85e9 tempest-TestStampPattern-920762642 None] Deleting attachment c33a0df5-9ab9-4ee5-90ff-a9a0ccf82823. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Flow 'volume_create_manager' (ecd454f5-9a7f-4d2e-a978-02b78712a80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e12764-8ad3-461b-9e5b-4c2aaa1e35d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e12764-8ad3-461b-9e5b-4c2aaa1e35d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1527134870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfa2cd0-21ef-4b93-bc74-858744f13b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d86a36c28d435c99cef226db51a72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:37Z,use_quota=True,user_id='a219939fa1b542f2904f6218ba792045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6adb32b-cc5b-428f-9a16-c8211f0caf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6adb32b-cc5b-428f-9a16-c8211f0caf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4b8a05-ac16-40f8-9139-a3738694c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4b8a05-ac16-40f8-9139-a3738694c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfa2cd0-21ef-4b93-bc74-858744f13b4b', 'volume_name': 'volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af60126-d6d2-4fec-bffd-eafca192cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af60126-d6d2-4fec-bffd-eafca192cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313129f5-bc40-49d0-aba6-f0f6b520382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:37 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Volume 4cfa2cd0-21ef-4b93-bc74-858744f13b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b', 'volume_size': 1}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1527134870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfa2cd0-21ef-4b93-bc74-858744f13b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d86a36c28d435c99cef226db51a72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:37Z,use_quota=True,user_id='a219939fa1b542f2904f6218ba792045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Creating volume 4cfa2cd0-21ef-4b93-bc74-858744f13b4b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:02:37 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:37 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b 1073741824
Jul 31 15:02:37 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:37 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b 1073741824" returned: 0 in 0.596s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:37 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b
Jul 31 15:02:37 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:38 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b" returned: 0 in 0.376s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:02:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313129f5-bc40-49d0-aba6-f0f6b520382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba31e862-15ef-42dd-95a9-0648b214a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Volume volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b (4cfa2cd0-21ef-4b93-bc74-858744f13b4b): created successfully
Jul 31 15:02:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba31e862-15ef-42dd-95a9-0648b214a067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Flow 'volume_create_manager' (ecd454f5-9a7f-4d2e-a978-02b78712a80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-31d2b1b4-d172-4c3f-b6c8-64493a2268ff tempest-AbsoluteLimitsTests-2101133694 None] Created volume successfully.
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-650cbbc0-353c-4197-840e-0c7712ec1d2a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Lock "cinder-650cbbc0-353c-4197-840e-0c7712ec1d2a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-quobyte-650cbbc0-353c-4197-840e-0c7712ec1d2a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Acquiring lock "cinder-4cfa2cd0-21ef-4b93-bc74-858744f13b4b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-650cbbc0-353c-4197-840e-0c7712ec1d2a" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Lock "cinder-4cfa2cd0-21ef-4b93-bc74-858744f13b4b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9fd56-723d-4c4e-811c-2721774c2990]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Acquiring lock "cinder-quobyte-4cfa2cd0-21ef-4b93-bc74-858744f13b4b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Lock "cinder-quobyte-4cfa2cd0-21ef-4b93-bc74-858744f13b4b" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[655aee86-44a0-47a7-bc1b-5b2e7419a2ba]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:39 devstack sudo[104310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a
Jul 31 15:02:39 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:39 devstack sudo[104311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b
Jul 31 15:02:39 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:39 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a" returned: 0 in 0.442s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:39 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a
Jul 31 15:02:39 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:39 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b" returned: 0 in 0.479s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:40 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b
Jul 31 15:02:40 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:40 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-650cbbc0-353c-4197-840e-0c7712ec1d2a" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-650cbbc0-353c-4197-840e-0c7712ec1d2a" released by "delete_volume" :: held 0.825s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Created reservations ['b37028c8-cc13-448a-bd75-6897a8e31077', 'c2d6fe55-3c94-44cd-b50c-c8030e0d7c27', 'e1aa2e1d-a2cf-4221-9103-44ea80d232be', '62e6d57f-d919-4740-aa84-0d021d52d607'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:40 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4cfa2cd0-21ef-4b93-bc74-858744f13b4b" returned: 0 in 0.293s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Lock "cinder-quobyte-4cfa2cd0-21ef-4b93-bc74-858744f13b4b" released by "delete_volume" :: held 0.828s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Created reservations ['5f5d9e8f-99a9-41f2-9b58-ad34d582a2e1', 'b80fa664-d720-4932-b9d3-8597451f3f58', 'b2857e90-b014-4c1a-90be-1e923b5fa482', '44d45f20-23ed-40a4-8de9-8e602d37a20e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:40 devstack sudo[104327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:40 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:40 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:40 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:40 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.342s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Deleted volume successfully.
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e051cec8-321a-4b91-ab22-1b6a1997d541 tempest-TestStampPattern-920762642 None] Lock "cinder-650cbbc0-353c-4197-840e-0c7712ec1d2a-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-9fb47b81-d579-48ff-8286-d20d588619e8-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Lock "cinder-9fb47b81-d579-48ff-8286-d20d588619e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-quobyte-21128f55-621b-4cd4-8bb1-1146e1d7bef3" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-21128f55-621b-4cd4-8bb1-1146e1d7bef3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-quobyte-9fb47b81-d579-48ff-8286-d20d588619e8" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-9fb47b81-d579-48ff-8286-d20d588619e8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Deleting offline snapshot 9fb47b81-d579-48ff-8286-d20d588619e8 of volume 21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] snapshot_file for this snap is: volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5046cd-e26c-4a35-aa7d-27ccf75e0e3d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:41 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.381s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Deleted volume successfully.
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b3062679-dfa9-4a13-aba0-589b28e9a72f tempest-AbsoluteLimitsTests-2101133694 None] Lock "cinder-4cfa2cd0-21ef-4b93-bc74-858744f13b4b-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:41 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8
Jul 31 15:02:41 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:41 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8" returned: 0 in 0.397s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d492e-0957-48a1-91ca-3f5d42c2a6ca]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:41 devstack sudo[104338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3
Jul 31 15:02:41 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:41 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3" returned: 0 in 0.550s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:41 devstack sudo[104343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8
Jul 31 15:02:41 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:42 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8" returned: 0 in 0.389s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:42 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8
Jul 31 15:02:42 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:42 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3.9fb47b81-d579-48ff-8286-d20d588619e8" returned: 0 in 0.282s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-9fb47b81-d579-48ff-8286-d20d588619e8" released by "_delete_snapshot" :: held 1.757s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-21128f55-621b-4cd4-8bb1-1146e1d7bef3" released by "delete_snapshot" :: held 1.791s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:42 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Created reservations ['dc392c0b-9601-49f8-bcb4-4f5d005163d1', '40450f77-d735-4e5e-8840-1d29c2ed36dc', '39cb2778-83c7-40ae-b3f3-9aead5be6a7b', '10c846ce-5cd3-477b-b11b-eb33656a4be2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:42 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Delete snapshot completed successfully.
Jul 31 15:02:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08e5b9bd-ceac-41ec-a5c8-3e0de1366633 tempest-TestStampPattern-920762642 None] Lock "cinder-9fb47b81-d579-48ff-8286-d20d588619e8-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Flow 'volume_create_manager' (d3d24d5b-78ad-4656-bf7b-04c83f372b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1891c5aa-7e29-4f05-9499-23bcf2a360a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1891c5aa-7e29-4f05-9499-23bcf2a360a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-143235183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5d3eaa-73ef-4532-9e72-192b0e35ac3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ff6d153201450da8d38c84601b218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:47Z,use_quota=True,user_id='e4366c942a6546b5bbd3edcdcfa3b25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921660de-cd7a-4bfe-86aa-957bb11ef539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921660de-cd7a-4bfe-86aa-957bb11ef539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2308b40d-06f8-4c43-a507-60783fcdcd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2308b40d-06f8-4c43-a507-60783fcdcd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5d3eaa-73ef-4532-9e72-192b0e35ac3d', 'volume_name': 'volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a824dd4-ebed-4f8a-b08e-db53d8001bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a824dd4-ebed-4f8a-b08e-db53d8001bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ddf8e6-fc3a-49b1-9f92-7d51cc5b58df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:47 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Volume fe5d3eaa-73ef-4532-9e72-192b0e35ac3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d', 'volume_size': 1}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-143235183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5d3eaa-73ef-4532-9e72-192b0e35ac3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ff6d153201450da8d38c84601b218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:47Z,use_quota=True,user_id='e4366c942a6546b5bbd3edcdcfa3b25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Creating volume fe5d3eaa-73ef-4532-9e72-192b0e35ac3d {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:02:47 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-21128f55-621b-4cd4-8bb1-1146e1d7bef3-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:47 devstack sudo[104386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d 1073741824
Jul 31 15:02:47 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Lock "cinder-21128f55-621b-4cd4-8bb1-1146e1d7bef3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Acquiring lock "cinder-quobyte-21128f55-621b-4cd4-8bb1-1146e1d7bef3" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-21128f55-621b-4cd4-8bb1-1146e1d7bef3" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44031250-0a40-4fa5-a9cb-0ac9802d5075]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:47 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3
Jul 31 15:02:47 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:47 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d 1073741824" returned: 0 in 0.747s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:48 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3" returned: 0 in 0.596s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:48 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d
Jul 31 15:02:48 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:48 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3
Jul 31 15:02:48 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:48 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d" returned: 0 in 0.355s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:48 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-21128f55-621b-4cd4-8bb1-1146e1d7bef3" returned: 0 in 0.357s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ddf8e6-fc3a-49b1-9f92-7d51cc5b58df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4291d871-bbc1-4902-a273-11399069a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Lock "cinder-quobyte-21128f55-621b-4cd4-8bb1-1146e1d7bef3" released by "delete_volume" :: held 1.051s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Volume volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d (fe5d3eaa-73ef-4532-9e72-192b0e35ac3d): created successfully
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4291d871-bbc1-4902-a273-11399069a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Flow 'volume_create_manager' (d3d24d5b-78ad-4656-bf7b-04c83f372b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-536e7cad-5e60-4428-bc2e-c981c53ff99c tempest-VolumesMetadataTest-1796276000 None] Created volume successfully.
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Created reservations ['0abd2416-2ba9-4ab9-b038-282adaf2a3ba', 'd7d585dd-da51-464f-8039-cc5a04e3e7c2', 'ada159a9-07b5-4dee-9b00-fecaa795dd3e', '69f80b33-839e-4227-85d7-4d9e6802f8a8'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:48 devstack sudo[104426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:48 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:48 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.282s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Deleted volume successfully.
Jul 31 15:02:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-438d45e7-6016-44ed-9e1e-a3360a53b543 tempest-TestStampPattern-920762642 None] Lock "cinder-21128f55-621b-4cd4-8bb1-1146e1d7bef3-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Acquiring lock "cinder-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Lock "cinder-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Acquiring lock "cinder-quobyte-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:02:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Lock "cinder-quobyte-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:02:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12712195-5386-4dfa-ae98-cbb9305f1da7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:50 devstack sudo[104484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d
Jul 31 15:02:50 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:51 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d" returned: 0 in 0.602s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:51 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d
Jul 31 15:02:51 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:51 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d" returned: 0 in 0.296s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Lock "cinder-quobyte-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d" released by "delete_volume" :: held 0.977s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Created reservations ['d7d56f3d-3c79-4bd4-a860-591f1b38b059', '1dc683de-b946-4e2e-b22c-292492f4432f', '24f15e21-f2e4-4fc9-9b09-c0f6f1a6002a', 'aaddcf5d-9871-4cb7-9240-503dfb39d0c4'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:51 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:51 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:51 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Deleted volume successfully.
Jul 31 15:02:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-72bdbdcb-5655-42ac-95ed-0ee9d734715b tempest-VolumesMetadataTest-1796276000 None] Lock "cinder-fe5d3eaa-73ef-4532-9e72-192b0e35ac3d-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Flow 'volume_create_manager' (2ffa4f0b-e756-4c0f-8647-53162b70410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e62d88-4187-4cad-91d8-d416c79fc59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e62d88-4187-4cad-91d8-d416c79fc59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1153874449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d178fd2e-8884-44f0-a17f-97a8b050ef06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb71a783122e4fd9b8d102417bd007e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:56Z,use_quota=True,user_id='9e8a7fe9d5cd4d5485cc47f553ff0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954c6b55-a693-42f9-9051-251b77148eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954c6b55-a693-42f9-9051-251b77148eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4f8b2c-64c6-4686-bab0-7c23afc73c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4f8b2c-64c6-4686-bab0-7c23afc73c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd178fd2e-8884-44f0-a17f-97a8b050ef06', 'volume_name': 'volume-d178fd2e-8884-44f0-a17f-97a8b050ef06', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6191fc0f-0c7c-4582-94dd-a822eecb11fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6191fc0f-0c7c-4582-94dd-a822eecb11fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e3ea42-aef9-467b-b517-fe8356e3ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:56 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Volume d178fd2e-8884-44f0-a17f-97a8b050ef06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d178fd2e-8884-44f0-a17f-97a8b050ef06', 'volume_size': 1}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1153874449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d178fd2e-8884-44f0-a17f-97a8b050ef06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb71a783122e4fd9b8d102417bd007e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:56Z,use_quota=True,user_id='9e8a7fe9d5cd4d5485cc47f553ff0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Creating volume d178fd2e-8884-44f0-a17f-97a8b050ef06 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:02:56 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:02:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:56 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06 1073741824
Jul 31 15:02:56 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:57 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06 1073741824" returned: 0 in 0.693s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:57 devstack sudo[104548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06
Jul 31 15:02:57 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Flow 'volume_create_manager' (dd34cbca-80d4-41d6-992c-5eca8b02013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9cc238-99d5-43bb-8672-870bc5704558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9cc238-99d5-43bb-8672-870bc5704558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-472548454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20755b8c-f9be-4397-80bb-8778251c492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af045711ddf143098b752ac7de75cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:57Z,use_quota=True,user_id='2448068025d649748c1609b8a52255a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce22389a-b574-47d0-852e-2f7c0ce26a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce22389a-b574-47d0-852e-2f7c0ce26a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de33677-2a48-45ee-b7c3-6f5c8648cf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:02:57 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e3ea42-aef9-467b-b517-fe8356e3ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d178fd2e-8884-44f0-a17f-97a8b050ef06', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3bf96e-5042-4cc1-9094-cf8b2b947a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Volume volume-d178fd2e-8884-44f0-a17f-97a8b050ef06 (d178fd2e-8884-44f0-a17f-97a8b050ef06): created successfully
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3bf96e-5042-4cc1-9094-cf8b2b947a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Flow 'volume_create_manager' (2ffa4f0b-e756-4c0f-8647-53162b70410b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:02:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-63cd6f95-3a11-4a6e-bb77-145b9213d612 tempest-TestMinimumBasicScenario-199147824 None] Created volume successfully.
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de33677-2a48-45ee-b7c3-6f5c8648cf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20755b8c-f9be-4397-80bb-8778251c492f', 'volume_name': 'volume-20755b8c-f9be-4397-80bb-8778251c492f', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda554b30>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de16f7b-557a-410c-8bf9-b4c94ee5ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de16f7b-557a-410c-8bf9-b4c94ee5ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e477627-386c-4513-a9d0-18c4ca084394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:02:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Volume 20755b8c-f9be-4397-80bb-8778251c492f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20755b8c-f9be-4397-80bb-8778251c492f', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda554b30>}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Trying to clone 20755b8c-f9be-4397-80bb-8778251c492f from image 6ede671b-18a7-43c3-97de-ba07f3408159 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:02:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:58 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:02:58 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:02:58 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Image download 20.69 MB at 20.69 MB/s
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b427453-974b-445a-b7a6-3b044edfde14]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:58 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.421s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:02:58 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD
Jul 31 15:02:58 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:58 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 is fetched for user 2448068025d649748c1609b8a52255a2. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cee39e-f0f0-48d7-be81-4f8650adf748]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:02:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:59 devstack sudo[104564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD
Jul 31 15:02:59 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:59 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-472548454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20755b8c-f9be-4397-80bb-8778251c492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af045711ddf143098b752ac7de75cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:02:57Z,use_quota=True,user_id='2448068025d649748c1609b8a52255a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Creating volume 20755b8c-f9be-4397-80bb-8778251c492f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:02:59 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:02:59 devstack sudo[104574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 1073741824
Jul 31 15:02:59 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:02:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-50d80314-0cce-4ab1-a178-dd836a182db2 req-bda6d58b-fedb-4332-9a8a-768e974f2aa2 tempest-TestMinimumBasicScenario-199147824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:00 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 1073741824" returned: 0 in 0.622s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:00 devstack sudo[104583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f
Jul 31 15:03:00 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:00 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f" returned: 0 in 0.266s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-50d80314-0cce-4ab1-a178-dd836a182db2 req-bda6d58b-fedb-4332-9a8a-768e974f2aa2 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.532s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-50d80314-0cce-4ab1-a178-dd836a182db2 req-bda6d58b-fedb-4332-9a8a-768e974f2aa2 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Attempting download of 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume 20755b8c-f9be-4397-80bb-8778251c492f. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-50d80314-0cce-4ab1-a178-dd836a182db2 req-bda6d58b-fedb-4332-9a8a-768e974f2aa2 tempest-TestMinimumBasicScenario-199147824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-d178fd2e-8884-44f0-a17f-97a8b050ef06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd222f96b-e4e7-43ed-aee5-e4b467cea513', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f452a-3599-494b-ac30-ad57a44c6ac1]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_bgkkuqec {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-50d80314-0cce-4ab1-a178-dd836a182db2 req-bda6d58b-fedb-4332-9a8a-768e974f2aa2 tempest-TestMinimumBasicScenario-199147824 None] attachment_update completed successfully.
Jul 31 15:03:00 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_bgkkuqec
Jul 31 15:03:00 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:01 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_bgkkuqec" returned: 0 in 0.533s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_bgkkuqec {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:01 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_bgkkuqec
Jul 31 15:03:01 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:01 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_bgkkuqec" returned: 1 in 0.367s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159_bgkkuqec' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f7b19f-9d83-49d9-8f09-f428cc838572]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:01 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD
Jul 31 15:03:01 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:01 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] 6ede671b-18a7-43c3-97de-ba07f3408159 was qcow2, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:03:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:01 devstack sudo[104985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f
Jul 31 15:03:01 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:04 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f" returned: 0 in 2.218s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_wlpdr26ddevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:03:04 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Converted 112.00 MB image at 50.44 MB/s
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:04 devstack sudo[104995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 1G
Jul 31 15:03:04 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:04 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 1G" returned: 0 in 0.477s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Downloaded image 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume 20755b8c-f9be-4397-80bb-8778251c492f successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 for user 2448068025d649748c1609b8a52255a2 is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Marking volume 20755b8c-f9be-4397-80bb-8778251c492f as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Copying metadata from image 6ede671b-18a7-43c3-97de-ba07f3408159 to 20755b8c-f9be-4397-80bb-8778251c492f. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Creating volume glance metadata for volume 20755b8c-f9be-4397-80bb-8778251c492f backed by image 6ede671b-18a7-43c3-97de-ba07f3408159 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e477627-386c-4513-a9d0-18c4ca084394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20755b8c-f9be-4397-80bb-8778251c492f', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda554b30>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f6e46b-3a03-4552-9b5a-d2353d9e23b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:04 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Volume volume-20755b8c-f9be-4397-80bb-8778251c492f (20755b8c-f9be-4397-80bb-8778251c492f): created successfully
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f6e46b-3a03-4552-9b5a-d2353d9e23b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Flow 'volume_create_manager' (dd34cbca-80d4-41d6-992c-5eca8b02013a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-dd0d79e9-78dd-45fc-8f63-6df718d6c844 tempest-VolumesExtendTest-768230799 None] Created volume successfully.
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (33d4c780-d046-4fb2-a470-8736d9c640fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ae766-634e-47d9-935e-4fa4191ee360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ae766-634e-47d9-935e-4fa4191ee360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618558751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd4aa24-e6fd-475b-a578-4294cb4fa4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:05Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf347db2-5b56-41bb-9d94-0a4bb0fb63ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf347db2-5b56-41bb-9d94-0a4bb0fb63ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be1a0e9-0fdc-4361-8d09-7703ee2c93df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be1a0e9-0fdc-4361-8d09-7703ee2c93df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd4aa24-e6fd-475b-a578-4294cb4fa4e4', 'volume_name': 'volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d2f0af-0654-4875-9785-b007ba525a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d2f0af-0654-4875-9785-b007ba525a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c9b3b3-ec85-407c-9053-e5964f1d73bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:05 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume 3cd4aa24-e6fd-475b-a578-4294cb4fa4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4', 'volume_size': 1}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618558751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd4aa24-e6fd-475b-a578-4294cb4fa4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:05Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Creating volume 3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:05 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:05 devstack sudo[105001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 1073741824
Jul 31 15:03:05 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:06 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 1073741824" returned: 0 in 0.629s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:06 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4
Jul 31 15:03:06 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:06 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4" returned: 0 in 0.392s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.415s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c9b3b3-ec85-407c-9053-e5964f1d73bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d85d1e-16bc-4e94-8b5f-06d44a2e9133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[891026a0-5cf8-4258-a626-3c180e6adefc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:06 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 (3cd4aa24-e6fd-475b-a578-4294cb4fa4e4): created successfully
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d85d1e-16bc-4e94-8b5f-06d44a2e9133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (33d4c780-d046-4fb2-a470-8736d9c640fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-dc517761-2bc4-46a8-b1ba-9861cf77663d tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created volume successfully.
Jul 31 15:03:06 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f
Jul 31 15:03:06 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:06 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f" returned: 0 in 0.438s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 2G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f 2G" returned: 0 in 0.112s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.585s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:07 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-09dc7f88-23ca-46f4-865e-8d449673aa61 tempest-VolumesExtendTest-768230799 None] Extend volume completed successfully.
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Acquiring lock "cinder-20755b8c-f9be-4397-80bb-8778251c492f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Lock "cinder-20755b8c-f9be-4397-80bb-8778251c492f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Acquiring lock "cinder-quobyte-20755b8c-f9be-4397-80bb-8778251c492f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-20755b8c-f9be-4397-80bb-8778251c492f" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee97394-28ad-494a-99c0-c4e44ed3d7a6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:07 devstack sudo[105050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f
Jul 31 15:03:07 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:07 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (92e0791d-a218-414a-86e3-c8c36aff50eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:08 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaa12ae-2d4e-4cf9-b83a-45d4a7c334b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f" returned: 0 in 0.465s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaa12ae-2d4e-4cf9-b83a-45d4a7c334b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409958379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4776412e-93ca-4265-96d2-26da14a1908c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:08Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8d6577-ac51-4858-b9e3-0be2272d6e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack sudo[105055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f
Jul 31 15:03:08 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8d6577-ac51-4858-b9e3-0be2272d6e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09933f4b-69d1-4247-a00d-edd84e8715a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09933f4b-69d1-4247-a00d-edd84e8715a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4776412e-93ca-4265-96d2-26da14a1908c', 'volume_name': 'volume-4776412e-93ca-4265-96d2-26da14a1908c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696c699d-2231-437a-aca6-65b5fccc77c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696c699d-2231-437a-aca6-65b5fccc77c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3e1b5a-d8dd-4bcf-9c0d-229ea4e72e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume 4776412e-93ca-4265-96d2-26da14a1908c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4776412e-93ca-4265-96d2-26da14a1908c', 'volume_size': 1}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409958379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4776412e-93ca-4265-96d2-26da14a1908c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:08Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Creating volume 4776412e-93ca-4265-96d2-26da14a1908c {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:08 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:08 devstack sudo[105057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c 1073741824
Jul 31 15:03:08 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:08 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-20755b8c-f9be-4397-80bb-8778251c492f" returned: 0 in 0.453s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-20755b8c-f9be-4397-80bb-8778251c492f" released by "delete_volume" :: held 0.983s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (c7295b58-9c49-4bc6-a481-95d5f8aed0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30576922-b992-406f-aa4c-8ec9a1517ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30576922-b992-406f-aa4c-8ec9a1517ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46165570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c328c595-73e7-49fc-80b7-34acc7b3d032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:09Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88eee83-72a9-45e9-8a60-0b6f14801775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88eee83-72a9-45e9-8a60-0b6f14801775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccea512-dcc2-47df-8151-ed7eca7abc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccea512-dcc2-47df-8151-ed7eca7abc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c328c595-73e7-49fc-80b7-34acc7b3d032', 'volume_name': 'volume-c328c595-73e7-49fc-80b7-34acc7b3d032', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef331bc-ec7c-4745-9d0b-2d8ca6964940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef331bc-ec7c-4745-9d0b-2d8ca6964940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d4aba3-b914-4f4b-b760-bc660bac1dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:08 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume c328c595-73e7-49fc-80b7-34acc7b3d032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c328c595-73e7-49fc-80b7-34acc7b3d032', 'volume_size': 1}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Created reservations ['edfa754b-7f48-49c0-9e93-113add7329af', 'cde957f0-fb66-43b4-94ff-a6d3bdc7b27d', 'ff5dbfc0-b5c0-44d9-bed7-e90891deed2c', '9e456f38-7488-480b-8509-9d788eb9d9e2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:08 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c 1073741824" returned: 0 in 0.716s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:08 devstack sudo[105064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:08 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:09 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c
Jul 31 15:03:09 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (803b0492-2167-4371-be6c-b2dee81293f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f44d4ff-08e1-42e2-aeb6-896db0cc1fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f44d4ff-08e1-42e2-aeb6-896db0cc1fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562373289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940b63ae-edd8-47e5-aabf-25f47a416876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:09Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40396da9-72a6-4480-aa93-5ed3d9aa1380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40396da9-72a6-4480-aa93-5ed3d9aa1380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a612ec7-fd24-4ee0-b2f5-82c5dd83e570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a612ec7-fd24-4ee0-b2f5-82c5dd83e570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940b63ae-edd8-47e5-aabf-25f47a416876', 'volume_name': 'volume-940b63ae-edd8-47e5-aabf-25f47a416876', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759d33a3-af38-4077-aee6-dce7b47236b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759d33a3-af38-4077-aee6-dce7b47236b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4370b7c-0302-46c8-b401-534c6ecd9bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume 940b63ae-edd8-47e5-aabf-25f47a416876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940b63ae-edd8-47e5-aabf-25f47a416876', 'volume_size': 1}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:09 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.360s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Deleted volume successfully.
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c9b82fc3-b74e-4c27-88ad-0163acde38b1 tempest-VolumesExtendTest-768230799 None] Lock "cinder-20755b8c-f9be-4397-80bb-8778251c492f-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:09 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c" returned: 0 in 0.386s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46165570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c328c595-73e7-49fc-80b7-34acc7b3d032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:09Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Creating volume c328c595-73e7-49fc-80b7-34acc7b3d032 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:09 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3e1b5a-d8dd-4bcf-9c0d-229ea4e72e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4776412e-93ca-4265-96d2-26da14a1908c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032 1073741824
Jul 31 15:03:09 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612556ba-da8b-47a5-b15a-860a268bc819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume volume-4776412e-93ca-4265-96d2-26da14a1908c (4776412e-93ca-4265-96d2-26da14a1908c): created successfully
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612556ba-da8b-47a5-b15a-860a268bc819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (92e0791d-a218-414a-86e3-c8c36aff50eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-84b1e0fa-5a4c-44cb-a147-3e1d0ac4a56e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created volume successfully.
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (d45ab045-c2d6-4dbe-856f-983162dadbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59a9910-c6cb-4bf9-b7fc-6c8d2ad762b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59a9910-c6cb-4bf9-b7fc-6c8d2ad762b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570028541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5b3fe1-f88c-4909-ae61-ef66ec979048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:10Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c182c1d0-ee57-4bc8-8a27-eab6760c3e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c182c1d0-ee57-4bc8-8a27-eab6760c3e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa07430-788b-431e-8a99-3d6cf5e4bbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa07430-788b-431e-8a99-3d6cf5e4bbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5b3fe1-f88c-4909-ae61-ef66ec979048', 'volume_name': 'volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8215e217-439a-486f-87a6-09c81068d103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8215e217-439a-486f-87a6-09c81068d103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78babd51-54bd-463d-abb8-a7f04837661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:09 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume 9d5b3fe1-f88c-4909-ae61-ef66ec979048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048', 'volume_size': 1}
Jul 31 15:03:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:10 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032 1073741824" returned: 0 in 0.688s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:10 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032
Jul 31 15:03:10 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:10 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032" returned: 0 in 0.362s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562373289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940b63ae-edd8-47e5-aabf-25f47a416876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:09Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Creating volume 940b63ae-edd8-47e5-aabf-25f47a416876 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:10 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:10 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876 1073741824
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d4aba3-b914-4f4b-b760-bc660bac1dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c328c595-73e7-49fc-80b7-34acc7b3d032', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2ef447-8635-40f9-8bb1-8550ee5f58b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume volume-c328c595-73e7-49fc-80b7-34acc7b3d032 (c328c595-73e7-49fc-80b7-34acc7b3d032): created successfully
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2ef447-8635-40f9-8bb1-8550ee5f58b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (c7295b58-9c49-4bc6-a481-95d5f8aed0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (9bb09433-a202-45e1-93bf-0055d03b2f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15002be-dfce-44ac-9b9d-064bddea94d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e08c5c63-b5d2-4087-a0d2-932c5bf0a9be tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created volume successfully.
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15002be-dfce-44ac-9b9d-064bddea94d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750877253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f30c8c-8651-493d-9390-462abb9cd239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:11Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a98c47-1d2f-4bf7-8b89-e5ad8572e6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a98c47-1d2f-4bf7-8b89-e5ad8572e6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9dcc38-fb90-4be2-bd7a-51b163ac49d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9dcc38-fb90-4be2-bd7a-51b163ac49d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f30c8c-8651-493d-9390-462abb9cd239', 'volume_name': 'volume-96f30c8c-8651-493d-9390-462abb9cd239', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb10bd0-9ed5-407b-bb61-5d9253e018b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb10bd0-9ed5-407b-bb61-5d9253e018b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8391a15-5bf3-4d2e-9b9d-e90b8719cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume 96f30c8c-8651-493d-9390-462abb9cd239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f30c8c-8651-493d-9390-462abb9cd239', 'volume_size': 1}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Flow 'volume_create_manager' (6af6711d-6f1c-47cc-add2-a72d761679d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bc2394-e9a2-4dec-81c9-73b4f4484129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bc2394-e9a2-4dec-81c9-73b4f4484129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-540549751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62733c05-51b3-46a2-9a59-a326ed97fb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af045711ddf143098b752ac7de75cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:11Z,use_quota=True,user_id='2448068025d649748c1609b8a52255a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b5752d-622d-40ae-b6d9-92c919c8fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b5752d-622d-40ae-b6d9-92c919c8fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91b0bee-46ea-47fb-a789-c8e7d983fce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91b0bee-46ea-47fb-a789-c8e7d983fce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62733c05-51b3-46a2-9a59-a326ed97fb2f', 'volume_name': 'volume-62733c05-51b3-46a2-9a59-a326ed97fb2f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e877fe-8f65-476a-9396-1da1260d9bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e877fe-8f65-476a-9396-1da1260d9bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73703367-03ed-47f8-956a-79c222c3cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Volume 62733c05-51b3-46a2-9a59-a326ed97fb2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62733c05-51b3-46a2-9a59-a326ed97fb2f', 'volume_size': 1}
Jul 31 15:03:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:11 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876 1073741824" returned: 0 in 0.608s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:11 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876
Jul 31 15:03:11 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:11 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.637s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570028541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5b3fe1-f88c-4909-ae61-ef66ec979048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:10Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Creating volume 9d5b3fe1-f88c-4909-ae61-ef66ec979048 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:11 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4370b7c-0302-46c8-b401-534c6ecd9bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940b63ae-edd8-47e5-aabf-25f47a416876', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:11 devstack sudo[105100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048 1073741824
Jul 31 15:03:11 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74a90dc-693e-4275-ab7b-04a48cfe4a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume volume-940b63ae-edd8-47e5-aabf-25f47a416876 (940b63ae-edd8-47e5-aabf-25f47a416876): created successfully
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74a90dc-693e-4275-ab7b-04a48cfe4a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (803b0492-2167-4371-be6c-b2dee81293f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-da0a49df-a292-43da-be96-e1e5543c9018 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created volume successfully.
Jul 31 15:03:11 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048 1073741824" returned: 0 in 0.409s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:11 devstack sudo[105106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048
Jul 31 15:03:11 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:12 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048" returned: 0 in 0.249s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750877253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f30c8c-8651-493d-9390-462abb9cd239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c72b3bbc0244f088588fbeab50e17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:11Z,use_quota=True,user_id='f4b6dccde0de4737ae2c778c92157929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Creating volume 96f30c8c-8651-493d-9390-462abb9cd239 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:12 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78babd51-54bd-463d-abb8-a7f04837661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:12 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239 1073741824
Jul 31 15:03:12 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af754313-9ac8-4b3b-85c3-dd6ce06ec04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:12 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048 (9d5b3fe1-f88c-4909-ae61-ef66ec979048): created successfully
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af754313-9ac8-4b3b-85c3-dd6ce06ec04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (d45ab045-c2d6-4dbe-856f-983162dadbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e2f8c72c-bd50-48bd-bea6-0221034f2c15 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created volume successfully.
Jul 31 15:03:12 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239 1073741824" returned: 0 in 0.496s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:12 devstack sudo[105116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239
Jul 31 15:03:12 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:12 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239" returned: 0 in 0.268s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-540549751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62733c05-51b3-46a2-9a59-a326ed97fb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af045711ddf143098b752ac7de75cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:11Z,use_quota=True,user_id='2448068025d649748c1609b8a52255a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Creating volume 62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:12 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8391a15-5bf3-4d2e-9b9d-e90b8719cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f30c8c-8651-493d-9390-462abb9cd239', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:12 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f 1073741824
Jul 31 15:03:12 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79943636-0f92-4279-a3f1-484fee11430c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:12 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Volume volume-96f30c8c-8651-493d-9390-462abb9cd239 (96f30c8c-8651-493d-9390-462abb9cd239): created successfully
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79943636-0f92-4279-a3f1-484fee11430c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Flow 'volume_create_manager' (9bb09433-a202-45e1-93bf-0055d03b2f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-953af80d-66b9-4e1c-a585-e86745bb3976 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created volume successfully.
Jul 31 15:03:13 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f 1073741824" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:13 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f
Jul 31 15:03:13 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:13 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-96f30c8c-8651-493d-9390-462abb9cd239-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73703367-03ed-47f8-956a-79c222c3cce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62733c05-51b3-46a2-9a59-a326ed97fb2f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6720c9e-ff41-40a6-9fd7-efed95725adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-96f30c8c-8651-493d-9390-462abb9cd239-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:13 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Volume volume-62733c05-51b3-46a2-9a59-a326ed97fb2f (62733c05-51b3-46a2-9a59-a326ed97fb2f): created successfully
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6720c9e-ff41-40a6-9fd7-efed95725adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Flow 'volume_create_manager' (6af6711d-6f1c-47cc-add2-a72d761679d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9e60bd86-a2ce-4f73-8b9a-0f3ce0c15d57 tempest-VolumesExtendTest-768230799 None] Created volume successfully.
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-quobyte-96f30c8c-8651-493d-9390-462abb9cd239" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-96f30c8c-8651-493d-9390-462abb9cd239" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[563caa3b-261f-49b3-8df1-d9d9d5ac26d1]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:13 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239
Jul 31 15:03:13 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:14 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239" returned: 0 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:14 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239
Jul 31 15:03:14 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:14 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-96f30c8c-8651-493d-9390-462abb9cd239" returned: 0 in 0.250s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-96f30c8c-8651-493d-9390-462abb9cd239" released by "delete_volume" :: held 0.664s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created reservations ['75495188-dc65-49d3-9e2a-03614e83710c', '9625d085-0877-403e-b58c-9a9ada935196', 'cdb8adb6-bd47-4aa7-9603-85e046f6b591', '628a7d1a-d20a-460f-a2c7-2b8b77477d84'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:14 devstack sudo[105136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:14 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:14 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:14 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Deleted volume successfully.
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-018aa072-eee7-490c-8edf-a02577b9802e tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-96f30c8c-8651-493d-9390-462abb9cd239-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-9d5b3fe1-f88c-4909-ae61-ef66ec979048-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-9d5b3fe1-f88c-4909-ae61-ef66ec979048-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-quobyte-9d5b3fe1-f88c-4909-ae61-ef66ec979048" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-9d5b3fe1-f88c-4909-ae61-ef66ec979048" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25eda86-c856-43ea-b5d3-f74c7223b3e7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Creating offline snapshot 29316b88-8531-4636-a847-fba423ccb0f4 of volume 62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5028ec9-59af-4d32-932f-e6ba3e9f35c7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:15 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048
Jul 31 15:03:15 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:15 devstack sudo[105140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f
Jul 31 15:03:15 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:15 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048" returned: 0 in 0.376s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:15 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048
Jul 31 15:03:15 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:15 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f" returned: 0 in 0.388s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:15 devstack sudo[105154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 1G
Jul 31 15:03:15 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:15 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9d5b3fe1-f88c-4909-ae61-ef66ec979048" returned: 0 in 0.344s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-9d5b3fe1-f88c-4909-ae61-ef66ec979048" released by "delete_volume" :: held 0.782s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created reservations ['6c2903b3-1564-4c99-a562-cb887035298c', '0a140da7-6b4c-428e-aabb-e9c04622a962', 'e75b544e-b70a-4648-9cae-6ee7af176108', '44bd7941-0aa1-4bb1-98bb-d7dfc0e04b15'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:15 devstack sudo[105194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:15 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:16 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 1G" returned: 0 in 0.655s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62733c05-51b3-46a2-9a59-a326ed97fb2f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-940b63ae-edd8-47e5-aabf-25f47a416876-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:16 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62733c05-51b3-46a2-9a59-a326ed97fb2f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4
Jul 31 15:03:16 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-940b63ae-edd8-47e5-aabf-25f47a416876-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-quobyte-940b63ae-edd8-47e5-aabf-25f47a416876" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-940b63ae-edd8-47e5-aabf-25f47a416876" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[df78113d-9c5f-480e-9633-7090fa2c6273]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:16 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.441s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Deleted volume successfully.
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d510b604-b0fd-4702-a8e4-202e94e9f08f tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-9d5b3fe1-f88c-4909-ae61-ef66ec979048-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:16 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876
Jul 31 15:03:16 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:16 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62733c05-51b3-46a2-9a59-a326ed97fb2f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4" returned: 0 in 0.370s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:16 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 is being set with open permissions: ugo+rw
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:16 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4
Jul 31 15:03:16 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:16 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876" returned: 0 in 0.467s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:16 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4" returned: 0 in 0.302s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:16 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876
Jul 31 15:03:16 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:16 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.info
Jul 31 15:03:16 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:17 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-940b63ae-edd8-47e5-aabf-25f47a416876" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-940b63ae-edd8-47e5-aabf-25f47a416876" released by "delete_volume" :: held 0.807s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:17 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.info" returned: 0 in 0.334s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:17 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.info is being set with open permissions: ugo+rw
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:17 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.info
Jul 31 15:03:17 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created reservations ['817fb57f-ffd7-4172-8c14-9d6a74e4958e', 'bad28f37-d1be-4a4a-b41c-adc3b5600061', '3b10a77c-234b-4ee9-a471-dca57770b563', '744bccbe-0b1a-40cb-b900-5757a2cea972'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:17 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:17 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-c328c595-73e7-49fc-80b7-34acc7b3d032-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-c328c595-73e7-49fc-80b7-34acc7b3d032-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-quobyte-c328c595-73e7-49fc-80b7-34acc7b3d032" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-c328c595-73e7-49fc-80b7-34acc7b3d032" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:17 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.info" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cebe38-6833-4b1f-99a5-03d5a4ee7389]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-380b588a-37f1-4c6a-978a-e7a94f3a2055 tempest-VolumesExtendTest-768230799 None] Create snapshot completed successfully
Jul 31 15:03:17 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.287s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Deleted volume successfully.
Jul 31 15:03:17 devstack sudo[105225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032
Jul 31 15:03:17 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f0ea2ede-129e-4258-af5d-5a216f79bfce tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-940b63ae-edd8-47e5-aabf-25f47a416876-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:17 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032" returned: 0 in 0.370s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:17 devstack sudo[105231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032
Jul 31 15:03:17 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:18 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c328c595-73e7-49fc-80b7-34acc7b3d032" returned: 0 in 0.237s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-c328c595-73e7-49fc-80b7-34acc7b3d032" released by "delete_volume" :: held 0.656s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created reservations ['32ea0ea7-6879-4d61-947e-f70acafd6dcf', 'c12b8d59-af3e-4f4e-ab5b-f2b4b5c35bdb', '56f645f7-6e2b-4e13-8c5d-996346b93fbc', '31af9f2c-531a-4030-befb-814bcc8dc684'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:18 devstack sudo[105234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:18 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca567533-7288-4d26-a5ad-b86a09438734]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:18 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f
Jul 31 15:03:18 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-4776412e-93ca-4265-96d2-26da14a1908c-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:18 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.329s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Deleted volume successfully.
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-4776412e-93ca-4265-96d2-26da14a1908c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-64dd52ab-a2b0-4f72-971a-0efe070d21a2 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-c328c595-73e7-49fc-80b7-34acc7b3d032-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-quobyte-4776412e-93ca-4265-96d2-26da14a1908c" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-4776412e-93ca-4265-96d2-26da14a1908c" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e91eebd-6914-49dc-b096-007139f13634]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:18 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f" returned: 0 in 0.409s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 2G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:18 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c
Jul 31 15:03:18 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 2G" returned: 0 in 0.157s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.602s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e623a95b-370f-49f2-9c73-50e5d94894f7 tempest-VolumesExtendTest-768230799 None] Extend volume completed successfully.
Jul 31 15:03:18 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c" returned: 0 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:19 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c
Jul 31 15:03:19 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:19 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4776412e-93ca-4265-96d2-26da14a1908c" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-4776412e-93ca-4265-96d2-26da14a1908c" released by "delete_volume" :: held 0.663s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created reservations ['73b3e778-8939-4ffc-b72c-ab3cfcfdc21a', 'fad6dbb4-b903-4edf-8072-fbe82680e37b', 'c40d2249-bc2e-488c-b76e-25a366510f0c', '7e09b081-07a9-4e75-a4ff-ad00582a3875'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:19 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:19 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Acquiring lock "cinder-29316b88-8531-4636-a847-fba423ccb0f4-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Lock "cinder-29316b88-8531-4636-a847-fba423ccb0f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Acquiring lock "cinder-quobyte-62733c05-51b3-46a2-9a59-a326ed97fb2f" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-62733c05-51b3-46a2-9a59-a326ed97fb2f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Acquiring lock "cinder-quobyte-29316b88-8531-4636-a847-fba423ccb0f4" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-29316b88-8531-4636-a847-fba423ccb0f4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Deleting offline snapshot 29316b88-8531-4636-a847-fba423ccb0f4 of volume 62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] snapshot_file for this snap is: volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b66368a-ce81-452a-aec1-13ff7a91c5d1]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:19 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.309s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:19 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Deleted volume successfully.
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-976cf49a-d727-4713-ba35-620935bf5743 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-4776412e-93ca-4265-96d2-26da14a1908c-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "cinder-quobyte-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:19 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4
Jul 31 15:03:19 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b1402-1059-4bcb-a476-624e6b36ed4e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:19 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4
Jul 31 15:03:19 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:20 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4" returned: 0 in 0.431s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62733c05-51b3-46a2-9a59-a326ed97fb2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e977235-6b4a-4df1-a536-19018d44a5c9]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:20 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4" returned: 0 in 0.382s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:20 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f
Jul 31 15:03:20 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:20 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4
Jul 31 15:03:20 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:20 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4" returned: 0 in 0.290s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:20 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f" returned: 0 in 0.416s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-quobyte-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4" released by "delete_volume" :: held 0.742s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:20 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4
Jul 31 15:03:20 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Created reservations ['7df923c4-d1d2-4df6-8c3e-a483cc12f3ae', '9bea2240-2669-47ff-9c46-af2aca3557ed', 'fb36a08d-c3f7-498c-b2db-f202ecb06d90', '8db2a0e3-a4d8-43d5-8ccb-92315c662177'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:20 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:20 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:21 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.394s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:21 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Deleted volume successfully.
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4" returned: 0 in 0.559s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-50902570-fc2f-4b5f-8ad3-78d1eb323a37 tempest-CreateVolumesFromSourceVolumeTest-24669731 None] Lock "cinder-3cd4aa24-e6fd-475b-a578-4294cb4fa4e4-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:21 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4
Jul 31 15:03:21 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:21 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f.29316b88-8531-4636-a847-fba423ccb0f4" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-29316b88-8531-4636-a847-fba423ccb0f4" released by "_delete_snapshot" :: held 1.856s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-62733c05-51b3-46a2-9a59-a326ed97fb2f" released by "delete_snapshot" :: held 1.884s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=118,cinder:INSERT=45,cinder:UPDATE=140,cinder:DELETE=16 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Created reservations ['19e43813-9d5c-48e6-9d1b-bdbe489abbc4', 'f5b63acd-c63c-4736-ad8b-e5bbf0370e32', 'e0dde371-c004-464a-8371-e44e7e58be9d', '847eb254-fb82-40fc-8888-7a5359266e5c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Delete snapshot completed successfully.
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5b7f97af-7c97-4bf3-8aa2-7abda0cfa2ba tempest-VolumesExtendTest-768230799 None] Lock "cinder-29316b88-8531-4636-a847-fba423ccb0f4-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Acquiring lock "cinder-62733c05-51b3-46a2-9a59-a326ed97fb2f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Lock "cinder-62733c05-51b3-46a2-9a59-a326ed97fb2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Acquiring lock "cinder-quobyte-62733c05-51b3-46a2-9a59-a326ed97fb2f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-62733c05-51b3-46a2-9a59-a326ed97fb2f" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaeb558-394f-434f-8af8-161e4832307a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:22 devstack sudo[105361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f
Jul 31 15:03:22 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:22 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f" returned: 0 in 0.600s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:22 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f
Jul 31 15:03:22 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:22 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-62733c05-51b3-46a2-9a59-a326ed97fb2f" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Lock "cinder-quobyte-62733c05-51b3-46a2-9a59-a326ed97fb2f" released by "delete_volume" :: held 0.958s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:22 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=144,cinder:UPDATE=168,cinder:INSERT=50,cinder:DELETE=9 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:03:22 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Created reservations ['e777dbe8-0d07-4c24-8a34-2ca72bc81e7b', 'c8384cc4-d58c-4c1c-b3ff-5d6e19241d38', 'a0f7300d-fca9-4988-aa6c-0865e7edf444', 'c1767cff-86b6-4d6e-8e69-fdf61b26d187'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:23 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:23 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:23 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.315s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:23 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Deleted volume successfully.
Jul 31 15:03:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-442031d2-d4db-4aa7-8afd-f38e0af1be4c tempest-VolumesExtendTest-768230799 None] Lock "cinder-62733c05-51b3-46a2-9a59-a326ed97fb2f-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Flow 'volume_create_manager' (cdb2b0c9-4c35-46d9-a037-9668fc3d8b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547dc2b4-83d4-4583-99a8-1eb90f6eb39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547dc2b4-83d4-4583-99a8-1eb90f6eb39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e381818-ed0e-44b9-9843-9e3e5a6552f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430b9013cca64fe59660206ba7da2608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:27Z,use_quota=True,user_id='46aadd6353a74207b47b5eecad3b17a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14be418e-42e7-4035-a65c-1478f7fdbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14be418e-42e7-4035-a65c-1478f7fdbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedfecd6-2063-429e-9cf7-f06e076df757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Flow 'volume_create_manager' (3bb4ac02-d5e1-4b31-a7bc-dc3d7b95ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10170c43-1aab-4007-8ee8-8ce29539cd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10170c43-1aab-4007-8ee8-8ce29539cd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-74599226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95920edb-cd38-4cab-b997-bd988fd5797b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e7c3696e7f40f89ea141c4384ab7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:27Z,use_quota=True,user_id='eb0a5ad4e41d48109ce33ec343f87e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9825b4e4-cafb-4d7b-85e8-d17fb558a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9825b4e4-cafb-4d7b-85e8-d17fb558a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209567e5-0ec9-4f8b-b38c-9e43e750b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209567e5-0ec9-4f8b-b38c-9e43e750b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95920edb-cd38-4cab-b997-bd988fd5797b', 'volume_name': 'volume-95920edb-cd38-4cab-b997-bd988fd5797b', 'volume_size': 2}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176d664e-9bad-45df-9ce1-fe8dd62bfb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176d664e-9bad-45df-9ce1-fe8dd62bfb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf9c603-8dc1-4574-92b1-9059f0439c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Volume 95920edb-cd38-4cab-b997-bd988fd5797b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95920edb-cd38-4cab-b997-bd988fd5797b', 'volume_size': 2}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-74599226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95920edb-cd38-4cab-b997-bd988fd5797b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e7c3696e7f40f89ea141c4384ab7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:27Z,use_quota=True,user_id='eb0a5ad4e41d48109ce33ec343f87e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Creating volume 95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:27 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b 2147483648 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:27 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b 2147483648
Jul 31 15:03:27 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedfecd6-2063-429e-9cf7-f06e076df757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e381818-ed0e-44b9-9843-9e3e5a6552f0', 'volume_name': 'volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0', 'volume_size': 1, 'image_id': 'df809574-5b44-40d3-b963-51a97a50b6e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df809574-5b44-40d3-b963-51a97a50b6e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4acb56026f7a5db72c22ff99c656bf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '430b9013cca64fe59660206ba7da2608', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '257752be0f37a422dab8782525e11e1c9abaf3434f79273fe3e83c36913ab495789998b41a543f9be73bb6bc7220c30bd2e005e04a50752e08a8e40c502699bd', 'id': 'df809574-5b44-40d3-b963-51a97a50b6e0', 'created_at': datetime.datetime(2026, 7, 31, 13, 3, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 3, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df809574-5b44-40d3-b963-51a97a50b6e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe4abf4d0>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef7cf0c-e948-4a7e-9ae4-cef059691dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef7cf0c-e948-4a7e-9ae4-cef059691dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c77b29-6214-449b-afcb-64cb4f7b5dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:27 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Volume 7e381818-ed0e-44b9-9843-9e3e5a6552f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0', 'volume_size': 1, 'image_id': 'df809574-5b44-40d3-b963-51a97a50b6e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df809574-5b44-40d3-b963-51a97a50b6e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4acb56026f7a5db72c22ff99c656bf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '430b9013cca64fe59660206ba7da2608', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '257752be0f37a422dab8782525e11e1c9abaf3434f79273fe3e83c36913ab495789998b41a543f9be73bb6bc7220c30bd2e005e04a50752e08a8e40c502699bd', 'id': 'df809574-5b44-40d3-b963-51a97a50b6e0', 'created_at': datetime.datetime(2026, 7, 31, 13, 3, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 3, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df809574-5b44-40d3-b963-51a97a50b6e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe4abf4d0>}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Trying to clone 7e381818-ed0e-44b9-9843-9e3e5a6552f0 from image df809574-5b44-40d3-b963-51a97a50b6e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df809574-5b44-40d3-b963-51a97a50b6e0', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:03:27 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Image download 0.00 MB at 0.00 MB/s
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[031fd897-8b4a-484a-8f2c-30c8409791f9]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:27 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD
Jul 31 15:03:27 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:27 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b 2147483648" returned: 0 in 0.505s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:28 devstack sudo[105390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b
Jul 31 15:03:28 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:28 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:28 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD
Jul 31 15:03:28 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:28 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf9c603-8dc1-4574-92b1-9059f0439c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95920edb-cd38-4cab-b997-bd988fd5797b', 'volume_size': 2}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f450da-54a8-447c-b26b-8ad3f9625927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Volume volume-95920edb-cd38-4cab-b997-bd988fd5797b (95920edb-cd38-4cab-b997-bd988fd5797b): created successfully
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f450da-54a8-447c-b26b-8ad3f9625927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Flow 'volume_create_manager' (3bb4ac02-d5e1-4b31-a7bc-dc3d7b95ab98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e499c97a-227c-41ad-aed6-0399a7e68f83 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Created volume successfully.
Jul 31 15:03:28 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Temporary image df809574-5b44-40d3-b963-51a97a50b6e0 is fetched for user 46aadd6353a74207b47b5eecad3b17a9. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb1f1f-a582-45ff-beff-15c2cb155c69]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:28 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD
Jul 31 15:03:28 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:28 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:28 devstack sudo[105402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD
Jul 31 15:03:28 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:29 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e381818-ed0e-44b9-9843-9e3e5a6552f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430b9013cca64fe59660206ba7da2608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:27Z,use_quota=True,user_id='46aadd6353a74207b47b5eecad3b17a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Creating volume 7e381818-ed0e-44b9-9843-9e3e5a6552f0 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:29 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:29 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 1073741824
Jul 31 15:03:29 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:29 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 1073741824" returned: 0 in 0.501s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:29 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0
Jul 31 15:03:29 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:29 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.312s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Creating offline snapshot 922ace28-c104-4b22-91d5-5a8c45f089bb of volume 95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:03:29 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Attempting download of df809574-5b44-40d3-b963-51a97a50b6e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/df809574-5b44-40d3-b963-51a97a50b6e0', 'metadata': {}}])) to volume 7e381818-ed0e-44b9-9843-9e3e5a6552f0. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8642dc5-cfc3-4b84-b7ba-8106612bfeb8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd49711-a5c9-4be7-9589-7869b05ef863]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df809574-5b44-40d3-b963-51a97a50b6e0_z8uhtkea {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:30 devstack sudo[105416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b
Jul 31 15:03:30 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:30 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df809574-5b44-40d3-b963-51a97a50b6e0_z8uhtkea
Jul 31 15:03:30 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:30 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:30 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df809574-5b44-40d3-b963-51a97a50b6e0_z8uhtkea" returned: 0 in 0.352s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df809574-5b44-40d3-b963-51a97a50b6e0_z8uhtkea {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b" returned: 0 in 0.437s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb 2G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:30 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb 2G
Jul 31 15:03:30 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:30 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df809574-5b44-40d3-b963-51a97a50b6e0_z8uhtkea
Jul 31 15:03:30 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:30 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df809574-5b44-40d3-b963-51a97a50b6e0_z8uhtkea" returned: 1 in 0.366s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df809574-5b44-40d3-b963-51a97a50b6e0_z8uhtkea' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05fd4b-12db-47f8-9933-3ce72ad25632]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:30 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb 2G" returned: 0 in 0.443s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95920edb-cd38-4cab-b997-bd988fd5797b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:30 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD
Jul 31 15:03:30 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:30 devstack sudo[105435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95920edb-cd38-4cab-b997-bd988fd5797b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb
Jul 31 15:03:30 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:31 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:31 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95920edb-cd38-4cab-b997-bd988fd5797b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb" returned: 0 in 0.321s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:31 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb is being set with open permissions: ugo+rw
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:31 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb
Jul 31 15:03:31 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:31 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD
Jul 31 15:03:31 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:31 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:31 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.info
Jul 31 15:03:31 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:31 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] df809574-5b44-40d3-b963-51a97a50b6e0 was raw, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:31 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0
Jul 31 15:03:31 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:31 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.info" returned: 0 in 0.282s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:31 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.info is being set with open permissions: ugo+rw
Jul 31 15:03:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:31 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.info
Jul 31 15:03:31 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:32 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0" returned: 0 in 0.458s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df809574-5b44-40d3-b963-51a97a50b6e0_6v7qx2gwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:03:32 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Converted 0.00 MB image at 0.00 MB/s
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:32 devstack sudo[105463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 1G
Jul 31 15:03:32 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:32 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.info" returned: 0 in 0.281s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-db676ec9-18a5-4c9b-a9ad-a9615bb489a7 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Create snapshot completed successfully
Jul 31 15:03:32 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 1G" returned: 0 in 0.339s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Downloaded image df809574-5b44-40d3-b963-51a97a50b6e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/df809574-5b44-40d3-b963-51a97a50b6e0', 'metadata': {}}])) to volume 7e381818-ed0e-44b9-9843-9e3e5a6552f0 successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Temporary image df809574-5b44-40d3-b963-51a97a50b6e0 for user 46aadd6353a74207b47b5eecad3b17a9 is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Marking volume 7e381818-ed0e-44b9-9843-9e3e5a6552f0 as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Copying metadata from image df809574-5b44-40d3-b963-51a97a50b6e0 to 7e381818-ed0e-44b9-9843-9e3e5a6552f0. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Creating volume glance metadata for volume 7e381818-ed0e-44b9-9843-9e3e5a6552f0 backed by image df809574-5b44-40d3-b963-51a97a50b6e0 with: {'image_id': 'df809574-5b44-40d3-b963-51a97a50b6e0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f4acb56026f7a5db72c22ff99c656bf7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c77b29-6214-449b-afcb-64cb4f7b5dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0', 'volume_size': 1, 'image_id': 'df809574-5b44-40d3-b963-51a97a50b6e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df809574-5b44-40d3-b963-51a97a50b6e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4acb56026f7a5db72c22ff99c656bf7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '430b9013cca64fe59660206ba7da2608', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '257752be0f37a422dab8782525e11e1c9abaf3434f79273fe3e83c36913ab495789998b41a543f9be73bb6bc7220c30bd2e005e04a50752e08a8e40c502699bd', 'id': 'df809574-5b44-40d3-b963-51a97a50b6e0', 'created_at': datetime.datetime(2026, 7, 31, 13, 3, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 3, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df809574-5b44-40d3-b963-51a97a50b6e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe4abf4d0>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2307c43c-af47-4f60-82e1-1aa02d0a8640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:32 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Volume volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 (7e381818-ed0e-44b9-9843-9e3e5a6552f0): created successfully
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2307c43c-af47-4f60-82e1-1aa02d0a8640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Flow 'volume_create_manager' (cdb2b0c9-4c35-46d9-a037-9668fc3d8b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-59b03aac-3281-4687-b69c-74874ac54d32 tempest-VolumeImageDependencyTests-313397378 None] Created volume successfully.
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "cinder-922ace28-c104-4b22-91d5-5a8c45f089bb-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-922ace28-c104-4b22-91d5-5a8c45f089bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "cinder-quobyte-95920edb-cd38-4cab-b997-bd988fd5797b" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-quobyte-95920edb-cd38-4cab-b997-bd988fd5797b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "cinder-quobyte-922ace28-c104-4b22-91d5-5a8c45f089bb" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-quobyte-922ace28-c104-4b22-91d5-5a8c45f089bb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Deleting offline snapshot 922ace28-c104-4b22-91d5-5a8c45f089bb of volume 95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] snapshot_file for this snap is: volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b3f25f-4791-40e2-b8f0-72e8ae8f1005]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:33 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb
Jul 31 15:03:33 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:33 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb" returned: 0 in 0.368s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95920edb-cd38-4cab-b997-bd988fd5797b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b7978-1213-4e0f-b335-2ec0abad8c3b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Acquiring lock "cinder-7e381818-ed0e-44b9-9843-9e3e5a6552f0-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Lock "cinder-7e381818-ed0e-44b9-9843-9e3e5a6552f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:33 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b
Jul 31 15:03:33 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Acquiring lock "cinder-quobyte-7e381818-ed0e-44b9-9843-9e3e5a6552f0" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Lock "cinder-quobyte-7e381818-ed0e-44b9-9843-9e3e5a6552f0" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ce7005-7aa9-49d9-b270-faa954daba8d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:33 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0
Jul 31 15:03:33 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:33 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b" returned: 0 in 0.422s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:33 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb
Jul 31 15:03:33 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:33 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0" returned: 0 in 0.416s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:34 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0
Jul 31 15:03:34 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:34 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb" returned: 0 in 0.368s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:34 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb
Jul 31 15:03:34 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:34 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e381818-ed0e-44b9-9843-9e3e5a6552f0" returned: 0 in 0.286s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Lock "cinder-quobyte-7e381818-ed0e-44b9-9843-9e3e5a6552f0" released by "delete_volume" :: held 0.746s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Created reservations ['7e7d3cb4-f13e-4f84-b582-01d7687f4aca', '84e8ebcc-03f3-4c31-bfa9-5468e1dffa07', 'd7db0e10-0502-44e2-afbf-1ac73a874153', '86a31896-aa3d-4537-87d0-255cffd3ac36'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:34 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b.922ace28-c104-4b22-91d5-5a8c45f089bb" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:34 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:34 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-quobyte-922ace28-c104-4b22-91d5-5a8c45f089bb" released by "_delete_snapshot" :: held 1.564s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-quobyte-95920edb-cd38-4cab-b997-bd988fd5797b" released by "delete_snapshot" :: held 1.587s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Created reservations ['886d8a55-60fe-4dbc-a0be-b09136c8b75c', 'fc17785f-cc29-4a79-935b-0adfe8ecf9bd', '8ea935ef-d1de-4175-baa7-f3f1a9dd5c78', '611ad5f7-0817-4d6e-a9c0-3cd32356cc9e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Delete snapshot completed successfully.
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b1aaa216-4456-4f8f-b3dc-648dbb3bc639 tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-922ace28-c104-4b22-91d5-5a8c45f089bb-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:34 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Deleted volume successfully.
Jul 31 15:03:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bde5a081-6c0e-4240-820e-0817942d8dc0 tempest-VolumeImageDependencyTests-313397378 None] Lock "cinder-7e381818-ed0e-44b9-9843-9e3e5a6552f0-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "cinder-95920edb-cd38-4cab-b997-bd988fd5797b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-95920edb-cd38-4cab-b997-bd988fd5797b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "cinder-quobyte-95920edb-cd38-4cab-b997-bd988fd5797b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-quobyte-95920edb-cd38-4cab-b997-bd988fd5797b" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eb3b0d-df37-4e70-a72a-89a9bed74e90]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:35 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b
Jul 31 15:03:35 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:35 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b" returned: 0 in 0.394s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:35 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b
Jul 31 15:03:35 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:35 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-95920edb-cd38-4cab-b997-bd988fd5797b" returned: 0 in 0.261s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-quobyte-95920edb-cd38-4cab-b997-bd988fd5797b" released by "delete_volume" :: held 0.719s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Created reservations ['e6c8b04c-2436-493f-95b9-36006660f983', '39884230-8e38-4864-b9fa-c359fd2ca4d7', '21274833-b16a-48cb-b092-5ac4e94ef6b2', 'c422dbd3-217b-428d-a37e-7e7edf9aebf0'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:36 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:36 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:36 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:36 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Deleted volume successfully.
Jul 31 15:03:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f1ecb41-aef6-4505-868b-048296e25fdf tempest-VolumesSnapshotNegativeTestJSON-648642475 None] Lock "cinder-95920edb-cd38-4cab-b997-bd988fd5797b-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Flow 'volume_create_manager' (210bfdb9-c5a5-433f-a45a-11b5fa3fc603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121520d8-6de0-435c-b864-e06c4aa3c1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121520d8-6de0-435c-b864-e06c4aa3c1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164984536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5ef785-f9ee-477a-a5ec-8f29aee64628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40881d94e60143bca561690704b169b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:39Z,use_quota=True,user_id='3332418d30734641a57b7a5763eed4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7108fc3a-6540-4063-9c4e-588005f3abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7108fc3a-6540-4063-9c4e-588005f3abf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238427fa-e8db-4528-b88f-c56545a74f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238427fa-e8db-4528-b88f-c56545a74f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5ef785-f9ee-477a-a5ec-8f29aee64628', 'volume_name': 'volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14867fa-98d9-4780-82c2-040ff7da8e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14867fa-98d9-4780-82c2-040ff7da8e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c1232-03a5-4411-9bf1-f4ade0e12ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Volume 0a5ef785-f9ee-477a-a5ec-8f29aee64628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628', 'volume_size': 1}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164984536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5ef785-f9ee-477a-a5ec-8f29aee64628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40881d94e60143bca561690704b169b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:39Z,use_quota=True,user_id='3332418d30734641a57b7a5763eed4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Creating volume 0a5ef785-f9ee-477a-a5ec-8f29aee64628 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:38 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:38 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628 1073741824
Jul 31 15:03:38 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:39 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628 1073741824" returned: 0 in 0.452s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:39 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628
Jul 31 15:03:39 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:39 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628" returned: 0 in 0.260s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c1232-03a5-4411-9bf1-f4ade0e12ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd9f54-2ded-46a6-b8c5-29e4636e8744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Volume volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628 (0a5ef785-f9ee-477a-a5ec-8f29aee64628): created successfully
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd9f54-2ded-46a6-b8c5-29e4636e8744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Flow 'volume_create_manager' (210bfdb9-c5a5-433f-a45a-11b5fa3fc603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f0733fc2-ad2e-4ca7-aa3b-eb961aadc4e3 tempest-ProjectReaderTests-436672385 None] Created volume successfully.
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Acquiring lock "cinder-0a5ef785-f9ee-477a-a5ec-8f29aee64628-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Lock "cinder-0a5ef785-f9ee-477a-a5ec-8f29aee64628-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Acquiring lock "cinder-quobyte-0a5ef785-f9ee-477a-a5ec-8f29aee64628" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Lock "cinder-quobyte-0a5ef785-f9ee-477a-a5ec-8f29aee64628" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8575397f-9800-4915-8279-d0120465679e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:40 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628
Jul 31 15:03:40 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:40 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:40 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628
Jul 31 15:03:40 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:40 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-0a5ef785-f9ee-477a-a5ec-8f29aee64628" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Lock "cinder-quobyte-0a5ef785-f9ee-477a-a5ec-8f29aee64628" released by "delete_volume" :: held 0.796s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Created reservations ['377ab713-6964-412e-91c4-9e93cf4e8141', 'b2d5b9db-6bb7-474b-ad6e-7319dd9c12a7', '95180e74-981c-4e93-b810-d2bfb3a68e36', '426f6485-c6bd-49ca-80aa-c2830d496bc7'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:40 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:40 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:41 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.303s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Deleted volume successfully.
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-80d0415e-22ad-495d-a0c8-6f240cdc72d6 tempest-ProjectReaderTests-436672385 None] Lock "cinder-0a5ef785-f9ee-477a-a5ec-8f29aee64628-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Flow 'volume_create_manager' (023978b0-915f-4326-b71c-30d8f3b5ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3951c612-0574-4eb4-8ef8-b3832b5dd6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3951c612-0574-4eb4-8ef8-b3832b5dd6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069625849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58736064-cc7a-4318-9177-f20c14cd6b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40881d94e60143bca561690704b169b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:42Z,use_quota=True,user_id='3332418d30734641a57b7a5763eed4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18edbfa3-4b65-4a1c-ae67-a78fdfde5faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18edbfa3-4b65-4a1c-ae67-a78fdfde5faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf1f00c-7111-4079-a99b-1e0797270541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf1f00c-7111-4079-a99b-1e0797270541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58736064-cc7a-4318-9177-f20c14cd6b0d', 'volume_name': 'volume-58736064-cc7a-4318-9177-f20c14cd6b0d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a861d26-036b-41da-a33c-38fecf1aeb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a861d26-036b-41da-a33c-38fecf1aeb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a313c5-2e2f-458d-a321-eeb4ad23a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:41 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Volume 58736064-cc7a-4318-9177-f20c14cd6b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58736064-cc7a-4318-9177-f20c14cd6b0d', 'volume_size': 1}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069625849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58736064-cc7a-4318-9177-f20c14cd6b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40881d94e60143bca561690704b169b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:03:42Z,use_quota=True,user_id='3332418d30734641a57b7a5763eed4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Creating volume 58736064-cc7a-4318-9177-f20c14cd6b0d {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:03:41 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:03:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:41 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d 1073741824
Jul 31 15:03:41 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:42 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d 1073741824" returned: 0 in 0.510s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:42 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d
Jul 31 15:03:42 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:42 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a313c5-2e2f-458d-a321-eeb4ad23a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58736064-cc7a-4318-9177-f20c14cd6b0d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4621dab6-f63e-4c6e-a3e9-8360cf3b6c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:03:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Volume volume-58736064-cc7a-4318-9177-f20c14cd6b0d (58736064-cc7a-4318-9177-f20c14cd6b0d): created successfully
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4621dab6-f63e-4c6e-a3e9-8360cf3b6c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:03:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Flow 'volume_create_manager' (023978b0-915f-4326-b71c-30d8f3b5ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:03:42 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fc52fe01-098a-413b-840f-c8ffa8869509 tempest-ProjectReaderTests-436672385 None] Created volume successfully.
Jul 31 15:03:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Acquiring lock "cinder-58736064-cc7a-4318-9177-f20c14cd6b0d-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Lock "cinder-58736064-cc7a-4318-9177-f20c14cd6b0d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Acquiring lock "cinder-quobyte-58736064-cc7a-4318-9177-f20c14cd6b0d" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Lock "cinder-quobyte-58736064-cc7a-4318-9177-f20c14cd6b0d" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465ef1e-ad0e-450d-8851-986ff31fac0e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:44 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d
Jul 31 15:03:44 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:44 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d" returned: 0 in 0.396s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:44 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d
Jul 31 15:03:44 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:44 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-58736064-cc7a-4318-9177-f20c14cd6b0d" returned: 0 in 0.358s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Lock "cinder-quobyte-58736064-cc7a-4318-9177-f20c14cd6b0d" released by "delete_volume" :: held 0.811s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Created reservations ['13f92dbc-dc29-4995-9a6d-d97cb951cc2b', 'd12e224e-7179-4391-bada-f25a0d462b3e', '7b4e74aa-172a-4c38-9cf6-643b89365100', 'f1d8e430-9685-499f-9134-8bb586ab7284'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:44 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:44 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:45 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.407s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:45 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Deleted volume successfully.
Jul 31 15:03:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e78e718-f5cb-4799-9ffa-3c9818b05f2e tempest-ProjectReaderTests-436672385 None] Lock "cinder-58736064-cc7a-4318-9177-f20c14cd6b0d-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-6f2157c8-7571-4bcf-8768-b7d856f91c45 req-4e19a602-0152-4b6a-8b6c-1685c091b308 tempest-TestMinimumBasicScenario-199147824 None] Terminate volume connection completed successfully.
Jul 31 15:03:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-6f2157c8-7571-4bcf-8768-b7d856f91c45 req-4e19a602-0152-4b6a-8b6c-1685c091b308 tempest-TestMinimumBasicScenario-199147824 None] Deleting attachment d222f96b-e4e7-43ed-aee5-e4b467cea513. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Acquiring lock "cinder-d178fd2e-8884-44f0-a17f-97a8b050ef06-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Lock "cinder-d178fd2e-8884-44f0-a17f-97a8b050ef06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Acquiring lock "cinder-quobyte-d178fd2e-8884-44f0-a17f-97a8b050ef06" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Lock "cinder-quobyte-d178fd2e-8884-44f0-a17f-97a8b050ef06" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9492da-b479-4fd2-8a13-ab9f3858c0d3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:50 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06
Jul 31 15:03:50 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:50 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06" returned: 0 in 0.497s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:50 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06
Jul 31 15:03:50 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:51 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d178fd2e-8884-44f0-a17f-97a8b050ef06" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Lock "cinder-quobyte-d178fd2e-8884-44f0-a17f-97a8b050ef06" released by "delete_volume" :: held 0.825s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Created reservations ['a41209ed-b11b-4501-86ea-74eccc7e295f', '23743a3a-6101-4b82-a813-d2d0e090ea66', '848910ab-aab0-4b66-81cc-b656843f8223', '1d75a28e-cd08-4d33-bc98-b24882ba6892'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:51 devstack sudo[105578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:51 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:51 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.312s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Deleted volume successfully.
Jul 31 15:03:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f431dd72-4194-4c4e-93c1-d22c5ddcef29 tempest-TestMinimumBasicScenario-199147824 None] Lock "cinder-d178fd2e-8884-44f0-a17f-97a8b050ef06-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:03:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:03:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:03:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:03:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:03:58 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:03:58 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:03:58 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.266s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:03:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Flow 'volume_create_manager' (d7f9d150-0990-4298-8686-bd64a87a65e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370704f7-2f0f-4271-90df-cdc382f1990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370704f7-2f0f-4271-90df-cdc382f1990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-143771338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaad332b-298e-40cb-814a-934e1aa2728b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2215c43a6c8411a9cc312509549f4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:04:02Z,use_quota=True,user_id='5941c9d525d74f6ba65dd772d433e94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36652ad-e130-4fa4-af3c-b5aab0f95942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36652ad-e130-4fa4-af3c-b5aab0f95942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabfadd3-4d03-443f-be91-a0a0e7cab459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabfadd3-4d03-443f-be91-a0a0e7cab459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aaad332b-298e-40cb-814a-934e1aa2728b', 'volume_name': 'volume-aaad332b-298e-40cb-814a-934e1aa2728b', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe488dc10>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf7cbfe-d051-4ace-af87-d2e9b3495990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf7cbfe-d051-4ace-af87-d2e9b3495990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cda4f9d-ea39-490a-8271-bcc0ff3f726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:04:02 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Volume aaad332b-298e-40cb-814a-934e1aa2728b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aaad332b-298e-40cb-814a-934e1aa2728b', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe488dc10>}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Trying to clone aaad332b-298e-40cb-814a-934e1aa2728b from image 6ede671b-18a7-43c3-97de-ba07f3408159 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:04:02 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:04:02 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Image download 20.69 MB at 20.69 MB/s
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2946fcea-21de-4003-89a6-abc41f7972f8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:03 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD
Jul 31 15:04:03 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:03 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 is fetched for user 5941c9d525d74f6ba65dd772d433e94b. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d280551-2ad9-4d95-bf59-e6a0b93f83d4]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:03 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD
Jul 31 15:04:03 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:03 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-143771338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaad332b-298e-40cb-814a-934e1aa2728b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2215c43a6c8411a9cc312509549f4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:04:02Z,use_quota=True,user_id='5941c9d525d74f6ba65dd772d433e94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Creating volume aaad332b-298e-40cb-814a-934e1aa2728b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:04:03 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:04:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:03 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b 1073741824
Jul 31 15:04:03 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:04 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b 1073741824" returned: 0 in 0.456s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:04 devstack sudo[105631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b
Jul 31 15:04:04 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:04 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Attempting download of 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume aaad332b-298e-40cb-814a-934e1aa2728b. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4702d1da-631b-45cd-9e06-2102d9d11136]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159__7kp_u0a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:04 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159__7kp_u0a
Jul 31 15:04:04 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:04 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159__7kp_u0a" returned: 0 in 0.338s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159__7kp_u0a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:05 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159__7kp_u0a
Jul 31 15:04:05 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:05 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159__7kp_u0a" returned: 1 in 0.328s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ede671b-18a7-43c3-97de-ba07f3408159__7kp_u0a' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:04:05 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201cb2e-a076-4773-9ca9-97240468647a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:04:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:05 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD
Jul 31 15:04:05 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:05 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:05 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] 6ede671b-18a7-43c3-97de-ba07f3408159 was qcow2, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:04:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:05 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b
Jul 31 15:04:05 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:07 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b" returned: 0 in 1.810s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ede671b-18a7-43c3-97de-ba07f3408159_44q32of_devstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:04:07 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Converted 112.00 MB image at 61.82 MB/s
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:07 devstack sudo[105658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b 1G
Jul 31 15:04:07 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:07 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b 1G" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Downloaded image 6ede671b-18a7-43c3-97de-ba07f3408159 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}])) to volume aaad332b-298e-40cb-814a-934e1aa2728b successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Temporary image 6ede671b-18a7-43c3-97de-ba07f3408159 for user 5941c9d525d74f6ba65dd772d433e94b is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Marking volume aaad332b-298e-40cb-814a-934e1aa2728b as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Copying metadata from image 6ede671b-18a7-43c3-97de-ba07f3408159 to aaad332b-298e-40cb-814a-934e1aa2728b. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:04:07 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Creating volume glance metadata for volume aaad332b-298e-40cb-814a-934e1aa2728b backed by image 6ede671b-18a7-43c3-97de-ba07f3408159 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:04:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cda4f9d-ea39-490a-8271-bcc0ff3f726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaad332b-298e-40cb-814a-934e1aa2728b', 'volume_size': 1, 'image_id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ede671b-18a7-43c3-97de-ba07f3408159', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd13f7485fa3946f2aea8738cf4440fe4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ede671b-18a7-43c3-97de-ba07f3408159', 'created_at': datetime.datetime(2026, 7, 31, 12, 43, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 12, 43, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ede671b-18a7-43c3-97de-ba07f3408159/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe488dc10>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:04:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647bf6c9-7e1d-417d-8c32-23633a9caa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:04:08 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Volume volume-aaad332b-298e-40cb-814a-934e1aa2728b (aaad332b-298e-40cb-814a-934e1aa2728b): created successfully
Jul 31 15:04:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647bf6c9-7e1d-417d-8c32-23633a9caa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:04:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Flow 'volume_create_manager' (d7f9d150-0990-4298-8686-bd64a87a65e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:04:08 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9b5e0b6f-0bbb-459a-ac1e-8095861520fd tempest-TestShelveInstance-1458596423 None] Created volume successfully.
Jul 31 15:04:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-49ca9cfa-9baa-4fe6-8077-7d70a9cf2bac req-e15db3b3-079a-4d2c-8810-8517aa9218f7 tempest-TestShelveInstance-1458596423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:04:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-49ca9cfa-9baa-4fe6-8077-7d70a9cf2bac req-e15db3b3-079a-4d2c-8810-8517aa9218f7 tempest-TestShelveInstance-1458596423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:04:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-49ca9cfa-9baa-4fe6-8077-7d70a9cf2bac req-e15db3b3-079a-4d2c-8810-8517aa9218f7 tempest-TestShelveInstance-1458596423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:04:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-49ca9cfa-9baa-4fe6-8077-7d70a9cf2bac req-e15db3b3-079a-4d2c-8810-8517aa9218f7 tempest-TestShelveInstance-1458596423 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-aaad332b-298e-40cb-814a-934e1aa2728b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fcfdebb-26c8-4b4e-b537-70cd1f9cc9fa', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 15:04:11 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-49ca9cfa-9baa-4fe6-8077-7d70a9cf2bac req-e15db3b3-079a-4d2c-8810-8517aa9218f7 tempest-TestShelveInstance-1458596423 None] attachment_update completed successfully.
Jul 31 15:04:21 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=67,cinder:SELECT=73,cinder:INSERT=29,cinder:DELETE=8 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:04:21 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=66,cinder:UPDATE=86,cinder:INSERT=27,cinder:DELETE=4 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:04:46 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-9f537b20-856e-4ff4-95f0-28753183be56 req-044d748d-e2bb-4d56-aa74-de24c5f90947 tempest-TestShelveInstance-1458596423 None] Terminate volume connection completed successfully.
Jul 31 15:04:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-9f537b20-856e-4ff4-95f0-28753183be56 req-044d748d-e2bb-4d56-aa74-de24c5f90947 tempest-TestShelveInstance-1458596423 None] Deleting attachment 4fcfdebb-26c8-4b4e-b537-70cd1f9cc9fa. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 15:04:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-31e12044-b326-49e5-9dd1-cb3910bbc876 req-34e62377-1138-4035-a496-297e9175113a tempest-TestShelveInstance-1458596423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:04:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-31e12044-b326-49e5-9dd1-cb3910bbc876 req-34e62377-1138-4035-a496-297e9175113a tempest-TestShelveInstance-1458596423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:04:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-31e12044-b326-49e5-9dd1-cb3910bbc876 req-34e62377-1138-4035-a496-297e9175113a tempest-TestShelveInstance-1458596423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:04:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-31e12044-b326-49e5-9dd1-cb3910bbc876 req-34e62377-1138-4035-a496-297e9175113a tempest-TestShelveInstance-1458596423 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-aaad332b-298e-40cb-814a-934e1aa2728b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf7847e6-f431-40c8-93c2-05b1f5537b50', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 15:04:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-31e12044-b326-49e5-9dd1-cb3910bbc876 req-34e62377-1138-4035-a496-297e9175113a tempest-TestShelveInstance-1458596423 None] attachment_update completed successfully.
Jul 31 15:04:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:04:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:04:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:04:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:04:58 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:04:58 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:04:58 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.242s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:04:58 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Flow 'volume_create_manager' (a57e8421-4658-47c6-9251-ca09ac82f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d48b11-1a78-4402-82e0-ad22db9a682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d48b11-1a78-4402-82e0-ad22db9a682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-966028670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc4f158-17bf-4473-bb1a-af986fe0338f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a779aabf9fa4ed2ba851651ebf97070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:02Z,use_quota=True,user_id='8f51d641bbb04362926a13aac24ef484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daa814b-6ad8-4f43-a41b-f3f3c8e54d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daa814b-6ad8-4f43-a41b-f3f3c8e54d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1332b6e-d735-4d7f-9c1f-9c4f0350e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1332b6e-d735-4d7f-9c1f-9c4f0350e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc4f158-17bf-4473-bb1a-af986fe0338f', 'volume_name': 'volume-4fc4f158-17bf-4473-bb1a-af986fe0338f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa41b872-1f17-4306-b4c7-b826fc1edbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa41b872-1f17-4306-b4c7-b826fc1edbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6deb6a-01ea-451d-87cd-cc43e12cc98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:02 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Volume 4fc4f158-17bf-4473-bb1a-af986fe0338f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc4f158-17bf-4473-bb1a-af986fe0338f', 'volume_size': 1}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-966028670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc4f158-17bf-4473-bb1a-af986fe0338f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a779aabf9fa4ed2ba851651ebf97070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:02Z,use_quota=True,user_id='8f51d641bbb04362926a13aac24ef484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Creating volume 4fc4f158-17bf-4473-bb1a-af986fe0338f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:02 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:02 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f 1073741824
Jul 31 15:05:02 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:03 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f 1073741824" returned: 0 in 0.435s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:03 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f
Jul 31 15:05:03 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:03 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6deb6a-01ea-451d-87cd-cc43e12cc98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc4f158-17bf-4473-bb1a-af986fe0338f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fa1098-9c4f-4140-8b5e-57b61c10dc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:03 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Volume volume-4fc4f158-17bf-4473-bb1a-af986fe0338f (4fc4f158-17bf-4473-bb1a-af986fe0338f): created successfully
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fa1098-9c4f-4140-8b5e-57b61c10dc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Flow 'volume_create_manager' (a57e8421-4658-47c6-9251-ca09ac82f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:03 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7e1ecfe6-9bde-40ba-a2f6-afc359c9c90b tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Created volume successfully.
Jul 31 15:05:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-1a8d263d-e82f-47b2-871b-5c392a2a5811 req-46545c89-b5e0-413d-abf8-dd0b6eba0dd6 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-1a8d263d-e82f-47b2-871b-5c392a2a5811 req-46545c89-b5e0-413d-abf8-dd0b6eba0dd6 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-1a8d263d-e82f-47b2-871b-5c392a2a5811 req-46545c89-b5e0-413d-abf8-dd0b6eba0dd6 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-1a8d263d-e82f-47b2-871b-5c392a2a5811 req-46545c89-b5e0-413d-abf8-dd0b6eba0dd6 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f', 'name': 'volume-4fc4f158-17bf-4473-bb1a-af986fe0338f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '770ed717-9cea-40c1-b447-a97ff3c9d4e1', 'enforce_multipath': True} {{(pid=88594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 31 15:05:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-1a8d263d-e82f-47b2-871b-5c392a2a5811 req-46545c89-b5e0-413d-abf8-dd0b6eba0dd6 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] attachment_update completed successfully.
Jul 31 15:05:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-12dbcacf-4c12-41ed-9397-c03c2a26c078 req-573bfd20-58b7-4d37-a3e1-d78b2977a93a tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Terminate volume connection completed successfully.
Jul 31 15:05:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-12dbcacf-4c12-41ed-9397-c03c2a26c078 req-573bfd20-58b7-4d37-a3e1-d78b2977a93a tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Deleting attachment 770ed717-9cea-40c1-b447-a97ff3c9d4e1. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Acquiring lock "cinder-4fc4f158-17bf-4473-bb1a-af986fe0338f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "cinder-4fc4f158-17bf-4473-bb1a-af986fe0338f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Acquiring lock "cinder-quobyte-4fc4f158-17bf-4473-bb1a-af986fe0338f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "cinder-quobyte-4fc4f158-17bf-4473-bb1a-af986fe0338f" acquired by "delete_volume" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[625b415c-ae25-472c-ae55-d9c2594d64ad]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:07 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f
Jul 31 15:05:07 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:07 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f" returned: 0 in 0.353s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:07 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f
Jul 31 15:05:07 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:07 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-4fc4f158-17bf-4473-bb1a-af986fe0338f" returned: 0 in 0.259s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "cinder-quobyte-4fc4f158-17bf-4473-bb1a-af986fe0338f" released by "delete_volume" :: held 0.647s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Created reservations ['a4e2634a-8443-410a-b2bd-124e5db3716c', '6c145f10-bcfb-482e-a34d-dd14cbcf856d', '80fb33c1-9ddd-4a53-893f-b8af040910a1', '09732dd2-5de3-4e7a-a33d-2d0e90922c19'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:07 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:07 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:08 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:08 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:08 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Deleted volume successfully.
Jul 31 15:05:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e64dce75-2e14-4a3e-b313-06bc39004168 tempest-TestServerVolumeAttachScenarioOldVersion-2047697184 None] Lock "cinder-4fc4f158-17bf-4473-bb1a-af986fe0338f-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-d3aeba6b-ec9e-4e78-9a4c-ba2e8529c369 tempest-TestShelveInstance-1458596423 None] Terminate volume connection completed successfully.
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-d3aeba6b-ec9e-4e78-9a4c-ba2e8529c369 tempest-TestShelveInstance-1458596423 None] Deleting attachment bf7847e6-f431-40c8-93c2-05b1f5537b50. {{(pid=88594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Acquiring lock "cinder-aaad332b-298e-40cb-814a-934e1aa2728b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Lock "cinder-aaad332b-298e-40cb-814a-934e1aa2728b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Acquiring lock "cinder-quobyte-aaad332b-298e-40cb-814a-934e1aa2728b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Lock "cinder-quobyte-aaad332b-298e-40cb-814a-934e1aa2728b" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aa444a-8d70-4a16-a249-dd79fcb502f2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:16 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b
Jul 31 15:05:16 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:16 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b" returned: 0 in 0.387s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:16 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b
Jul 31 15:05:16 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:17 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aaad332b-298e-40cb-814a-934e1aa2728b" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Lock "cinder-quobyte-aaad332b-298e-40cb-814a-934e1aa2728b" released by "delete_volume" :: held 0.686s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG cinder.quota [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Created reservations ['5bfa3958-6d61-430e-a89a-6a70b8b292cd', 'b2b7a596-ea9c-480e-bad2-5e300a3aade3', '38ff2696-d2a0-4f43-9e9a-1f05449b1c3b', '29331b9d-3430-42c7-8637-4e59d9264a1e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:17 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:17 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:17 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG cinder.manager [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Deleted volume successfully.
Jul 31 15:05:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [req-2cdd2de4-d841-4c82-89ec-a8693e65c5e7 req-2ef5d8f0-eeea-45c8-ae9a-e23d8ce18a1d tempest-TestShelveInstance-1458596423 None] Lock "cinder-aaad332b-298e-40cb-814a-934e1aa2728b-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Flow 'volume_create_manager' (d6c1191b-cb29-47f5-83bd-da0583648c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e23b24e-0742-4720-aaa3-9c8102e340fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e23b24e-0742-4720-aaa3-9c8102e340fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad8aafe-1475-4bf6-9a4b-f81af20fde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f4e66192ae4ae384516bdcda31332a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:27Z,use_quota=True,user_id='4073967a0c784f7282edaa74b3d6765e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99581d38-aa87-4561-8945-ea836380abb7),volume_type_id=99581d38-aa87-4561-8945-ea836380abb7)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8651c668-5611-4a5f-ba93-0a3a9b3cf6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8651c668-5611-4a5f-ba93-0a3a9b3cf6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe57d72-809d-427f-a678-3a7bad222a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe57d72-809d-427f-a678-3a7bad222a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fad8aafe-1475-4bf6-9a4b-f81af20fde39', 'volume_name': 'volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39', 'volume_size': 1, 'image_id': '11da6962-22d9-45d0-8682-8a8aae159a6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11da6962-22d9-45d0-8682-8a8aae159a6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2f41fbcdc78c7abeb20851efb905285', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '68f4e66192ae4ae384516bdcda31332a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '725b2c68021a8cb4d057d6d0d26b045ca9f311bec7fb4947548bff4e6680a02f3d6759f360d517e7cee9f49fcbdc6f97be9e827d9be2a062f2b7fbe2c628af1b', 'id': '11da6962-22d9-45d0-8682-8a8aae159a6d', 'created_at': datetime.datetime(2026, 7, 31, 13, 5, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 5, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11da6962-22d9-45d0-8682-8a8aae159a6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda554f20>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a6555-1fbb-4439-81a4-c9fe5f3c35c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a6555-1fbb-4439-81a4-c9fe5f3c35c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a181e33-e118-4fec-bdf7-b05bb6798422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:27 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Volume fad8aafe-1475-4bf6-9a4b-f81af20fde39: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39', 'volume_size': 1, 'image_id': '11da6962-22d9-45d0-8682-8a8aae159a6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11da6962-22d9-45d0-8682-8a8aae159a6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2f41fbcdc78c7abeb20851efb905285', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '68f4e66192ae4ae384516bdcda31332a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '725b2c68021a8cb4d057d6d0d26b045ca9f311bec7fb4947548bff4e6680a02f3d6759f360d517e7cee9f49fcbdc6f97be9e827d9be2a062f2b7fbe2c628af1b', 'id': '11da6962-22d9-45d0-8682-8a8aae159a6d', 'created_at': datetime.datetime(2026, 7, 31, 13, 5, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 5, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11da6962-22d9-45d0-8682-8a8aae159a6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda554f20>}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Trying to clone fad8aafe-1475-4bf6-9a4b-f81af20fde39 from image 11da6962-22d9-45d0-8682-8a8aae159a6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/11da6962-22d9-45d0-8682-8a8aae159a6d', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:05:27 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Image download 0.00 MB at 0.00 MB/s
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfe1e55-1a9a-4e4b-a5e4-24590fde29ec]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:28 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD
Jul 31 15:05:28 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:28 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (84532757-3753-4ad3-8b8c-8fe1b217855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b271a29-f832-4abc-ab1d-51474f18ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD
Jul 31 15:05:28 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b271a29-f832-4abc-ab1d-51474f18ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91736975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7336a40f-e617-4944-a69d-f41cdd6fb4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:28Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9553745-1751-462b-bd96-8274ad798f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9553745-1751-462b-bd96-8274ad798f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c189ae-0d03-422b-80d5-e51eb09e092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c189ae-0d03-422b-80d5-e51eb09e092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7336a40f-e617-4944-a69d-f41cdd6fb4de', 'volume_name': 'volume-7336a40f-e617-4944-a69d-f41cdd6fb4de', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9673978c-a56f-4e9c-9e64-63380690f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9673978c-a56f-4e9c-9e64-63380690f86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62927710-7e45-40d2-af60-0011e1c6bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Volume 7336a40f-e617-4944-a69d-f41cdd6fb4de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7336a40f-e617-4944-a69d-f41cdd6fb4de', 'volume_size': 1}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91736975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7336a40f-e617-4944-a69d-f41cdd6fb4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:28Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Creating volume 7336a40f-e617-4944-a69d-f41cdd6fb4de {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:28 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:28 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de 1073741824
Jul 31 15:05:28 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:28 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Temporary image 11da6962-22d9-45d0-8682-8a8aae159a6d is fetched for user 4073967a0c784f7282edaa74b3d6765e. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f6b126-7016-45b5-862a-375e996f5dbb]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (9a94523b-ccb4-4581-9b5a-753dda399580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fc0c0f-caa5-4aa2-92bb-68bb1528f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fc0c0f-caa5-4aa2-92bb-68bb1528f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292810256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a61986-9ebe-4d68-9593-09aa08b0189e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:29Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e592b2-eb94-4c86-92cb-bae12711d340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e592b2-eb94-4c86-92cb-bae12711d340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eaeca7-deea-4310-9307-1931ed079d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eaeca7-deea-4310-9307-1931ed079d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a61986-9ebe-4d68-9593-09aa08b0189e', 'volume_name': 'volume-f6a61986-9ebe-4d68-9593-09aa08b0189e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c853c4-e5e3-40aa-9d3d-8ad0d82ef14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c853c4-e5e3-40aa-9d3d-8ad0d82ef14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b1cf3a-afde-4dd0-9bb4-8caa7a2988d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Volume f6a61986-9ebe-4d68-9593-09aa08b0189e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a61986-9ebe-4d68-9593-09aa08b0189e', 'volume_size': 1}
Jul 31 15:05:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:28 devstack sudo[107093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD
Jul 31 15:05:28 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:29 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de 1073741824" returned: 0 in 0.524s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:29 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de
Jul 31 15:05:29 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (fee030d1-d9d2-4465-b610-459cc44a83fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fe8912-8ea4-4302-b65b-a394d1007d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fe8912-8ea4-4302-b65b-a394d1007d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884057114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dd2b77-06d2-4c59-8686-d868905cd428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:29Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fae852-025d-4b08-9f9c-80170a0d4280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fae852-025d-4b08-9f9c-80170a0d4280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0d4a9f-6e12-4b88-b6e1-9e10a48e0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0d4a9f-6e12-4b88-b6e1-9e10a48e0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90dd2b77-06d2-4c59-8686-d868905cd428', 'volume_name': 'volume-90dd2b77-06d2-4c59-8686-d868905cd428', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5808098b-8bab-4774-a23d-b777e0af0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5808098b-8bab-4774-a23d-b777e0af0824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd4e0a0-6a53-4669-bfc6-623eb8ee3d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Volume 90dd2b77-06d2-4c59-8686-d868905cd428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90dd2b77-06d2-4c59-8686-d868905cd428', 'volume_size': 1}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:29 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD
Jul 31 15:05:29 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:29 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de" returned: 0 in 0.341s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292810256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a61986-9ebe-4d68-9593-09aa08b0189e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:29Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Creating volume f6a61986-9ebe-4d68-9593-09aa08b0189e {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:29 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62927710-7e45-40d2-af60-0011e1c6bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7336a40f-e617-4944-a69d-f41cdd6fb4de', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017a1075-cc7f-4251-b132-3402fee9e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e 1073741824
Jul 31 15:05:29 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Volume volume-7336a40f-e617-4944-a69d-f41cdd6fb4de (7336a40f-e617-4944-a69d-f41cdd6fb4de): created successfully
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017a1075-cc7f-4251-b132-3402fee9e327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (84532757-3753-4ad3-8b8c-8fe1b217855e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (72720704-f486-4c29-bff1-4da3a29815c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f008978-d332-4372-96e7-541ebaffde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e8e4f151-1eb3-4b7f-99aa-ad9badf8edb5 tempest-CreateVolumesFromImageTest-59782891 None] Created volume successfully.
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD" returned: 1 in 0.420s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f008978-d332-4372-96e7-541ebaffde53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-412346351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b811fa3-4375-4f1e-9384-80d9345a7fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:29Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e1447-cbd4-4d32-884c-84af3ed2e9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e1447-cbd4-4d32-884c-84af3ed2e9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe57370-ac5e-4add-9569-e44a3693a116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe57370-ac5e-4add-9569-e44a3693a116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b811fa3-4375-4f1e-9384-80d9345a7fd9', 'volume_name': 'volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f861bc95-85bb-406c-b0ea-bff262cf922e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f861bc95-85bb-406c-b0ea-bff262cf922e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f54d7e-3e7f-41b2-a31f-0b8fe692ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Volume 9b811fa3-4375-4f1e-9384-80d9345a7fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9', 'volume_size': 1}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (ba68838e-55d2-440e-8caa-4a02e4ad38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dee1ca-50e4-4faf-b3bb-8418f3dcb2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dee1ca-50e4-4faf-b3bb-8418f3dcb2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579652041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7db89b-dec5-4fbb-9502-c4195268ba7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:30Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df881b57-939d-4b9d-b881-7ef89e816cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df881b57-939d-4b9d-b881-7ef89e816cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4887325-8de3-4106-acca-70f18004b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4887325-8de3-4106-acca-70f18004b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7db89b-dec5-4fbb-9502-c4195268ba7b', 'volume_name': 'volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f873047f-76fa-4497-bec3-675629e649f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f873047f-76fa-4497-bec3-675629e649f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd532543-a287-47c1-978f-365667ea31bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Volume 5f7db89b-dec5-4fbb-9502-c4195268ba7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b', 'volume_size': 1}
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:29 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e 1073741824" returned: 0 in 0.542s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:30 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e
Jul 31 15:05:30 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:30 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e" returned: 0 in 0.240s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884057114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dd2b77-06d2-4c59-8686-d868905cd428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:29Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Creating volume 90dd2b77-06d2-4c59-8686-d868905cd428 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:30 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b1cf3a-afde-4dd0-9bb4-8caa7a2988d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a61986-9ebe-4d68-9593-09aa08b0189e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:30 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428 1073741824
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4b2a40-553d-4195-bcba-912e74ca3e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:30 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Volume volume-f6a61986-9ebe-4d68-9593-09aa08b0189e (f6a61986-9ebe-4d68-9593-09aa08b0189e): created successfully
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4b2a40-553d-4195-bcba-912e74ca3e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (9a94523b-ccb4-4581-9b5a-753dda399580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5c5ff7f1-ee3c-4d7d-b7c7-abd8b3de9d25 tempest-CreateVolumesFromImageTest-59782891 None] Created volume successfully.
Jul 31 15:05:30 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428 1073741824" returned: 0 in 0.440s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:30 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428
Jul 31 15:05:30 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:31 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428" returned: 0 in 0.243s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad8aafe-1475-4bf6-9a4b-f81af20fde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f4e66192ae4ae384516bdcda31332a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:27Z,use_quota=True,user_id='4073967a0c784f7282edaa74b3d6765e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99581d38-aa87-4561-8945-ea836380abb7),volume_type_id=99581d38-aa87-4561-8945-ea836380abb7)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Creating volume fad8aafe-1475-4bf6-9a4b-f81af20fde39 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:31 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd4e0a0-6a53-4669-bfc6-623eb8ee3d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90dd2b77-06d2-4c59-8686-d868905cd428', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:31 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 1073741824
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9568157b-fee9-4a13-a4f8-6a5588dd36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:31 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Volume volume-90dd2b77-06d2-4c59-8686-d868905cd428 (90dd2b77-06d2-4c59-8686-d868905cd428): created successfully
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9568157b-fee9-4a13-a4f8-6a5588dd36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (fee030d1-d9d2-4465-b610-459cc44a83fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e0a625f6-2352-4d85-8b54-1d305c3dab66 tempest-CreateVolumesFromImageTest-59782891 None] Created volume successfully.
Jul 31 15:05:31 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 1073741824" returned: 0 in 0.415s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:31 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39
Jul 31 15:05:31 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:31 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39" returned: 0 in 0.245s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.062s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-412346351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b811fa3-4375-4f1e-9384-80d9345a7fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:29Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Creating volume 9b811fa3-4375-4f1e-9384-80d9345a7fd9 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:31 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:31 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9 1073741824
Jul 31 15:05:31 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Attempting download of 11da6962-22d9-45d0-8682-8a8aae159a6d ((None, [{'url': 'file:///opt/stack/data/glance/images/11da6962-22d9-45d0-8682-8a8aae159a6d', 'metadata': {}}])) to volume fad8aafe-1475-4bf6-9a4b-f81af20fde39. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3135f-18cd-4cc2-a208-ff4cef2cb8d2]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11da6962-22d9-45d0-8682-8a8aae159a6d_u97fu6_c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:31 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11da6962-22d9-45d0-8682-8a8aae159a6d_u97fu6_c
Jul 31 15:05:31 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:32 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11da6962-22d9-45d0-8682-8a8aae159a6d_u97fu6_c" returned: 0 in 0.328s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11da6962-22d9-45d0-8682-8a8aae159a6d_u97fu6_c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:32 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9 1073741824" returned: 0 in 0.449s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:32 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9
Jul 31 15:05:32 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:32 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11da6962-22d9-45d0-8682-8a8aae159a6d_u97fu6_c
Jul 31 15:05:32 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:32 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.539s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:32 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579652041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7db89b-dec5-4fbb-9502-c4195268ba7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e305e787a3834f82983a46f406177ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:30Z,use_quota=True,user_id='c9b0d1fd541f443e88693e7cef1e1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Creating volume 5f7db89b-dec5-4fbb-9502-c4195268ba7b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:32 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11da6962-22d9-45d0-8682-8a8aae159a6d_u97fu6_c" returned: 1 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11da6962-22d9-45d0-8682-8a8aae159a6d_u97fu6_c' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[de50bc2e-2a8e-4ec2-a955-9fed9d378c89]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:32 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b 1073741824
Jul 31 15:05:32 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f54d7e-3e7f-41b2-a31f-0b8fe692ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b262d6db-02fa-4e43-84a8-97a9be41753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:32 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Volume volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9 (9b811fa3-4375-4f1e-9384-80d9345a7fd9): created successfully
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b262d6db-02fa-4e43-84a8-97a9be41753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (72720704-f486-4c29-bff1-4da3a29815c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-cf15bc2f-5655-4b50-af6b-cbb32e77d116 tempest-CreateVolumesFromImageTest-59782891 None] Created volume successfully.
Jul 31 15:05:32 devstack sudo[107154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD
Jul 31 15:05:32 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:32 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:32 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b 1073741824" returned: 0 in 0.435s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:32 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD
Jul 31 15:05:32 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:32 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b
Jul 31 15:05:32 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:33 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b" returned: 0 in 0.241s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:33 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] 11da6962-22d9-45d0-8682-8a8aae159a6d was raw, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd532543-a287-47c1-978f-365667ea31bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9c85f9-2aba-4141-a75b-8e9726873604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:33 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39
Jul 31 15:05:33 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:33 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Volume volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b (5f7db89b-dec5-4fbb-9502-c4195268ba7b): created successfully
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9c85f9-2aba-4141-a75b-8e9726873604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Flow 'volume_create_manager' (ba68838e-55d2-440e-8caa-4a02e4ad38e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8cfc351b-d031-404c-9271-3ea9a15cc222 tempest-CreateVolumesFromImageTest-59782891 None] Created volume successfully.
Jul 31 15:05:33 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39" returned: 0 in 0.456s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11da6962-22d9-45d0-8682-8a8aae159a6d_r8jw8aa3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:05:33 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Converted 0.00 MB image at 0.00 MB/s
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:33 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 1G
Jul 31 15:05:33 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:33 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 1G" returned: 0 in 0.291s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Downloaded image 11da6962-22d9-45d0-8682-8a8aae159a6d ((None, [{'url': 'file:///opt/stack/data/glance/images/11da6962-22d9-45d0-8682-8a8aae159a6d', 'metadata': {}}])) to volume fad8aafe-1475-4bf6-9a4b-f81af20fde39 successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Temporary image 11da6962-22d9-45d0-8682-8a8aae159a6d for user 4073967a0c784f7282edaa74b3d6765e is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Marking volume fad8aafe-1475-4bf6-9a4b-f81af20fde39 as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Copying metadata from image 11da6962-22d9-45d0-8682-8a8aae159a6d to fad8aafe-1475-4bf6-9a4b-f81af20fde39. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:05:33 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Creating volume glance metadata for volume fad8aafe-1475-4bf6-9a4b-f81af20fde39 backed by image 11da6962-22d9-45d0-8682-8a8aae159a6d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '11da6962-22d9-45d0-8682-8a8aae159a6d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a2f41fbcdc78c7abeb20851efb905285', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a181e33-e118-4fec-bdf7-b05bb6798422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39', 'volume_size': 1, 'image_id': '11da6962-22d9-45d0-8682-8a8aae159a6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11da6962-22d9-45d0-8682-8a8aae159a6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2f41fbcdc78c7abeb20851efb905285', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '68f4e66192ae4ae384516bdcda31332a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '725b2c68021a8cb4d057d6d0d26b045ca9f311bec7fb4947548bff4e6680a02f3d6759f360d517e7cee9f49fcbdc6f97be9e827d9be2a062f2b7fbe2c628af1b', 'id': '11da6962-22d9-45d0-8682-8a8aae159a6d', 'created_at': datetime.datetime(2026, 7, 31, 13, 5, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 5, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11da6962-22d9-45d0-8682-8a8aae159a6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda554f20>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffb60a4-9349-4afe-8eab-4e89be0171cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:34 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Volume volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 (fad8aafe-1475-4bf6-9a4b-f81af20fde39): created successfully
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffb60a4-9349-4afe-8eab-4e89be0171cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Flow 'volume_create_manager' (d6c1191b-cb29-47f5-83bd-da0583648c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8a3975f5-6ad5-49e3-8ad8-ef51c8aaffa7 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Created volume successfully.
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-5f7db89b-dec5-4fbb-9502-c4195268ba7b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-5f7db89b-dec5-4fbb-9502-c4195268ba7b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-quobyte-5f7db89b-dec5-4fbb-9502-c4195268ba7b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-5f7db89b-dec5-4fbb-9502-c4195268ba7b" acquired by "delete_volume" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3413dad6-027c-440e-8c9b-3b92a7047361]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:34 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b
Jul 31 15:05:34 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:34 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b" returned: 0 in 0.357s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:34 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b
Jul 31 15:05:34 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Acquiring lock "cinder-fad8aafe-1475-4bf6-9a4b-f81af20fde39-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "cinder-fad8aafe-1475-4bf6-9a4b-f81af20fde39-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Acquiring lock "cinder-quobyte-fad8aafe-1475-4bf6-9a4b-f81af20fde39" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "cinder-quobyte-fad8aafe-1475-4bf6-9a4b-f81af20fde39" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb4e866-dc87-440b-8c57-82ae4111fc6f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:34 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5f7db89b-dec5-4fbb-9502-c4195268ba7b" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:35 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39
Jul 31 15:05:35 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-5f7db89b-dec5-4fbb-9502-c4195268ba7b" released by "delete_volume" :: held 0.656s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Created reservations ['05b004db-9470-4bd5-9920-015c2fd272c3', '93736434-6908-4f8b-b3c2-acd5a92076bf', 'eca9afc3-ba60-407a-b5b0-b4a04e7cb31a', '91b4e307-9bde-4d24-a02e-779403bdf4b5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:35 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:35 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:35 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39" returned: 0 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:35 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39
Jul 31 15:05:35 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:35 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.268s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Deleted volume successfully.
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9545d3e9-0810-413c-ba8c-b72e59752759 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-5f7db89b-dec5-4fbb-9502-c4195268ba7b-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-9b811fa3-4375-4f1e-9384-80d9345a7fd9-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-9b811fa3-4375-4f1e-9384-80d9345a7fd9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-quobyte-9b811fa3-4375-4f1e-9384-80d9345a7fd9" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:35 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-fad8aafe-1475-4bf6-9a4b-f81af20fde39" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-9b811fa3-4375-4f1e-9384-80d9345a7fd9" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "cinder-quobyte-fad8aafe-1475-4bf6-9a4b-f81af20fde39" released by "delete_volume" :: held 0.708s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e67fc4-95ad-4ab2-860d-7f8d6eaae9b7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:35 devstack cinder-volume[88594]: WARNING cinder.quota [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 31 15:05:35 devstack cinder-volume[88594]: WARNING cinder.quota [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Created reservations ['579f3f3a-4ce2-4301-be31-9f5fcd0c8a5a', 'f7b4c6c8-8093-45a5-8e80-7addfb9196d9', 'b8fd7e2f-cdbd-41ab-87e5-8c7280d17c88', '6eefac95-c89a-42c2-8b3c-d74d1d50bd2a'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:35 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9
Jul 31 15:05:35 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:35 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:35 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:35 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:35 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9" returned: 0 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Deleted volume successfully.
Jul 31 15:05:35 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9
Jul 31 15:05:35 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a1a0467f-1b68-47f9-9a24-9a7cbed95ea4 tempest-VolumeAndVolumeTypeFromImageTest-778673825 None] Lock "cinder-fad8aafe-1475-4bf6-9a4b-f81af20fde39-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:36 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9b811fa3-4375-4f1e-9384-80d9345a7fd9" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-9b811fa3-4375-4f1e-9384-80d9345a7fd9" released by "delete_volume" :: held 0.681s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Created reservations ['fa082976-6deb-4737-aadd-f858d4b93bbb', 'c64ffc6d-6ee0-4fee-809f-0087c50626fe', 'f26ca833-3e07-494b-9f2c-c463083fed40', 'ee218253-6ea0-4516-89ec-d1b8bc00ceb5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:36 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:36 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:36 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Deleted volume successfully.
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-41c0e6e3-6d40-4e3f-8b54-31346bb1c1d4 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-9b811fa3-4375-4f1e-9384-80d9345a7fd9-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-90dd2b77-06d2-4c59-8686-d868905cd428-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-90dd2b77-06d2-4c59-8686-d868905cd428-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-quobyte-90dd2b77-06d2-4c59-8686-d868905cd428" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-90dd2b77-06d2-4c59-8686-d868905cd428" acquired by "delete_volume" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b8f189-e7ba-4cc6-9c94-104515a328a9]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:36 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428
Jul 31 15:05:36 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:37 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:37 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428
Jul 31 15:05:37 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:37 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-90dd2b77-06d2-4c59-8686-d868905cd428" returned: 0 in 0.274s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-90dd2b77-06d2-4c59-8686-d868905cd428" released by "delete_volume" :: held 0.703s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Created reservations ['fc3a872b-9446-4133-a6ea-6b341ccfda4b', '4d7d7a73-b71b-4319-8d04-43ce2b2671c6', 'a10ccbf1-541f-41f2-9c86-10f3bbefb3b7', '8dbf4b4e-d4ec-4af1-b8f8-3ad7a72c2693'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:37 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:37 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:37 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-f6a61986-9ebe-4d68-9593-09aa08b0189e-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:37 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Deleted volume successfully.
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-f6a61986-9ebe-4d68-9593-09aa08b0189e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6c6a05a-b4cb-4d10-bf3c-84ae85c652fe tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-90dd2b77-06d2-4c59-8686-d868905cd428-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-quobyte-f6a61986-9ebe-4d68-9593-09aa08b0189e" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-f6a61986-9ebe-4d68-9593-09aa08b0189e" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8a5f3-1c30-45bb-85d7-dbefc8bd86d0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:38 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e
Jul 31 15:05:38 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:38 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e" returned: 0 in 0.384s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:38 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e
Jul 31 15:05:38 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:38 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-f6a61986-9ebe-4d68-9593-09aa08b0189e" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-f6a61986-9ebe-4d68-9593-09aa08b0189e" released by "delete_volume" :: held 0.679s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Created reservations ['175a3fa9-d6ee-417c-8159-314ef7329d36', 'fee31027-0279-4d6b-9006-7d356dfb909d', 'a2c4e5dc-38b9-4e5c-aa3e-068786367ef9', '99d0e63c-0fee-4753-a2fa-c6cd5df5c5cc'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:38 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:38 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:39 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-7336a40f-e617-4944-a69d-f41cdd6fb4de-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.273s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Deleted volume successfully.
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-7336a40f-e617-4944-a69d-f41cdd6fb4de-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8327d69e-ff55-4ca5-9bc0-6c4b52298970 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-f6a61986-9ebe-4d68-9593-09aa08b0189e-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "cinder-quobyte-7336a40f-e617-4944-a69d-f41cdd6fb4de" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-7336a40f-e617-4944-a69d-f41cdd6fb4de" acquired by "delete_volume" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef8b7af-acd9-48bf-a6c1-2d30e223bd23]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:39 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de
Jul 31 15:05:39 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:39 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de" returned: 0 in 0.373s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:39 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de
Jul 31 15:05:39 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:39 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7336a40f-e617-4944-a69d-f41cdd6fb4de" returned: 0 in 0.256s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-quobyte-7336a40f-e617-4944-a69d-f41cdd6fb4de" released by "delete_volume" :: held 0.671s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Created reservations ['caeed134-a2e3-4ed5-b2b9-30aba56e7420', 'e15ebf0e-a962-4e4d-a2f1-10df924b5cff', '6def9ea5-4735-4aec-95ed-35bb8341cbc8', '8866e43c-bc84-4d2d-a97f-bebb6f63b914'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:39 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:39 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:40 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Deleted volume successfully.
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-abf43587-a975-4855-82ae-08459fa21bc6 tempest-CreateVolumesFromImageTest-59782891 None] Lock "cinder-7336a40f-e617-4944-a69d-f41cdd6fb4de-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Flow 'volume_create_manager' (9f62bfb4-a974-43dc-9e6a-0e2b21530a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45345f31-cff3-4be5-9e5f-84e2c7e336aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45345f31-cff3-4be5-9e5f-84e2c7e336aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b3e429-f138-4ee1-b4b6-c1980c4ad221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6d2da088a94027994169724f1cb7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:40Z,use_quota=True,user_id='2a176cda72c04ca4be37d047b5637c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179f626a-2a38-4c04-a2bd-c53f8bb84028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179f626a-2a38-4c04-a2bd-c53f8bb84028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bcacba-fc80-42b5-a92f-adae562f9dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bcacba-fc80-42b5-a92f-adae562f9dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b3e429-f138-4ee1-b4b6-c1980c4ad221', 'volume_name': 'volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ace645-62f0-4667-b19f-3bfcd77396f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ace645-62f0-4667-b19f-3bfcd77396f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4e53fa-ceb9-48f5-a87f-df2bfff2f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Volume 91b3e429-f138-4ee1-b4b6-c1980c4ad221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221', 'volume_size': 1}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b3e429-f138-4ee1-b4b6-c1980c4ad221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6d2da088a94027994169724f1cb7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:40Z,use_quota=True,user_id='2a176cda72c04ca4be37d047b5637c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Creating volume 91b3e429-f138-4ee1-b4b6-c1980c4ad221 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:40 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:40 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221 1073741824
Jul 31 15:05:40 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:41 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221 1073741824" returned: 0 in 0.459s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:41 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221
Jul 31 15:05:41 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:41 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4e53fa-ceb9-48f5-a87f-df2bfff2f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d9e5e1-2200-49b9-a9bc-fdf6f989b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:41 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Volume volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221 (91b3e429-f138-4ee1-b4b6-c1980c4ad221): created successfully
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d9e5e1-2200-49b9-a9bc-fdf6f989b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:41 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Flow 'volume_create_manager' (9f62bfb4-a974-43dc-9e6a-0e2b21530a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4d9c227b-0527-4d16-88a3-cf7a74c563cf tempest-CinderUnicodeTest-911806038 None] Created volume successfully.
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Flow 'volume_create_manager' (d2da4c03-5420-4afb-8a56-7811603ec17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cfe5f1-6fdf-4390-a854-793ed55bff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cfe5f1-6fdf-4390-a854-793ed55bff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1011109913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2c82b1-0c65-4630-a530-25c0f3d21dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6d2da088a94027994169724f1cb7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:42Z,use_quota=True,user_id='2a176cda72c04ca4be37d047b5637c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d74ba71-ae20-4c1a-8782-14af8468bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d74ba71-ae20-4c1a-8782-14af8468bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b164db5-0358-471e-9dbe-78b02aa1bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b164db5-0358-471e-9dbe-78b02aa1bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2c82b1-0c65-4630-a530-25c0f3d21dca', 'volume_name': 'volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324353cd-9a7b-4783-891e-6e2cb7941903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324353cd-9a7b-4783-891e-6e2cb7941903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59bdd48-453b-483b-9daf-a9238f78400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Volume aa2c82b1-0c65-4630-a530-25c0f3d21dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca', 'volume_size': 1}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1011109913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2c82b1-0c65-4630-a530-25c0f3d21dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6d2da088a94027994169724f1cb7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:42Z,use_quota=True,user_id='2a176cda72c04ca4be37d047b5637c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Creating volume aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:42 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:42 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca 1073741824
Jul 31 15:05:42 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:42 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca 1073741824" returned: 0 in 0.438s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:42 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca
Jul 31 15:05:42 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:42 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59bdd48-453b-483b-9daf-a9238f78400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e088d-0e0a-4bea-842f-7d2badb53433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Volume volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca (aa2c82b1-0c65-4630-a530-25c0f3d21dca): created successfully
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e088d-0e0a-4bea-842f-7d2badb53433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Flow 'volume_create_manager' (d2da4c03-5420-4afb-8a56-7811603ec17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:42 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2f6fc54d-a6b1-4b4d-a65f-846aa946662c tempest-CinderUnicodeTest-911806038 None] Created volume successfully.
Jul 31 15:05:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Creating offline snapshot 11893bcb-fe67-404b-8ca8-852741d26d0e of volume aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:05:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6b0894-90c5-487e-83bd-62076163530f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:43 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca
Jul 31 15:05:43 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:43 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca" returned: 0 in 0.372s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:43 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e 1G
Jul 31 15:05:43 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:44 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e 1G" returned: 0 in 0.423s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:44 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e
Jul 31 15:05:44 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:44 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:44 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e is being set with open permissions: ugo+rw
Jul 31 15:05:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:44 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e
Jul 31 15:05:44 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:44 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e" returned: 0 in 0.258s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:44 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.info
Jul 31 15:05:44 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:45 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.info" returned: 0 in 0.266s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:45 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.info is being set with open permissions: ugo+rw
Jul 31 15:05:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:45 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.info
Jul 31 15:05:45 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:45 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.info" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-94bd38c7-0149-48e6-85f3-d82901f68007 tempest-CinderUnicodeTest-911806038 None] Create snapshot completed successfully
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Acquiring lock "cinder-11893bcb-fe67-404b-8ca8-852741d26d0e-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Lock "cinder-11893bcb-fe67-404b-8ca8-852741d26d0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Acquiring lock "cinder-quobyte-aa2c82b1-0c65-4630-a530-25c0f3d21dca" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-aa2c82b1-0c65-4630-a530-25c0f3d21dca" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Acquiring lock "cinder-quobyte-11893bcb-fe67-404b-8ca8-852741d26d0e" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-11893bcb-fe67-404b-8ca8-852741d26d0e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Deleting offline snapshot 11893bcb-fe67-404b-8ca8-852741d26d0e of volume aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] snapshot_file for this snap is: volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a6fdd-8db7-43f2-aefc-218c01bb0251]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:46 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e
Jul 31 15:05:46 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:46 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0556cfe-e875-4155-9309-c03ff2c270f5]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:47 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca
Jul 31 15:05:47 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:47 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:47 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e
Jul 31 15:05:47 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:47 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e" returned: 0 in 0.325s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:47 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e
Jul 31 15:05:47 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:47 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca.11893bcb-fe67-404b-8ca8-852741d26d0e" returned: 0 in 0.237s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-11893bcb-fe67-404b-8ca8-852741d26d0e" released by "_delete_snapshot" :: held 1.352s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-aa2c82b1-0c65-4630-a530-25c0f3d21dca" released by "delete_snapshot" :: held 1.383s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Created reservations ['e87b8eca-7c7a-4f58-bafa-d58e1702070f', 'c930d70d-72a3-4185-b5b0-896c63fb54c8', '7418ed14-da7e-4036-9ac5-135cf1c5805c', '0cb09777-d417-4201-8920-f484c297deb8'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Delete snapshot completed successfully.
Jul 31 15:05:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-55832f5b-7ccd-4480-991c-f2972b3ed7a6 tempest-CinderUnicodeTest-911806038 None] Lock "cinder-11893bcb-fe67-404b-8ca8-852741d26d0e-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Acquiring lock "cinder-aa2c82b1-0c65-4630-a530-25c0f3d21dca-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Lock "cinder-aa2c82b1-0c65-4630-a530-25c0f3d21dca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Acquiring lock "cinder-quobyte-aa2c82b1-0c65-4630-a530-25c0f3d21dca" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-aa2c82b1-0c65-4630-a530-25c0f3d21dca" acquired by "delete_volume" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:48 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e92b1f0-965a-4dfb-975c-f5fd1e8630d1]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:48 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca
Jul 31 15:05:48 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:49 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca" returned: 0 in 0.345s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:49 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca
Jul 31 15:05:49 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:49 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-aa2c82b1-0c65-4630-a530-25c0f3d21dca" returned: 0 in 0.243s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-aa2c82b1-0c65-4630-a530-25c0f3d21dca" released by "delete_volume" :: held 0.641s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Created reservations ['7986549d-51bc-492f-9792-2ca26a552298', '173e21db-2ce0-4110-9c3d-08af5c90ecfa', '8e45effe-6766-4fd9-a243-6248362bfbdf', '7c28df05-854c-46d8-9f0f-022b63175811'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:49 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:49 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:49 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.238s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Deleted volume successfully.
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16abd18f-8d6e-496a-9791-689e91cc304d tempest-CinderUnicodeTest-911806038 None] Lock "cinder-aa2c82b1-0c65-4630-a530-25c0f3d21dca-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Acquiring lock "cinder-91b3e429-f138-4ee1-b4b6-c1980c4ad221-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Lock "cinder-91b3e429-f138-4ee1-b4b6-c1980c4ad221-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Acquiring lock "cinder-quobyte-91b3e429-f138-4ee1-b4b6-c1980c4ad221" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-91b3e429-f138-4ee1-b4b6-c1980c4ad221" acquired by "delete_volume" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63ce29-dc14-4df1-95ca-a2b5954c6c07]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:50 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221
Jul 31 15:05:50 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:50 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221" returned: 0 in 0.344s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:50 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221
Jul 31 15:05:50 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:50 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-91b3e429-f138-4ee1-b4b6-c1980c4ad221" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Lock "cinder-quobyte-91b3e429-f138-4ee1-b4b6-c1980c4ad221" released by "delete_volume" :: held 0.646s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Created reservations ['0eb6b74a-1cff-4af6-8b80-2c30fee364a3', '0a3af2e1-87ef-44b3-aeb1-2630e714859c', '4082704b-40e3-4b9a-8cc5-937cac9c24db', 'f8dc4be1-80ab-43fb-b39f-8ef4b959de23'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:50 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:50 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:50 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.235s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Deleted volume successfully.
Jul 31 15:05:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d1aa9907-99fa-402a-b742-4c84acf0512a tempest-CinderUnicodeTest-911806038 None] Lock "cinder-91b3e429-f138-4ee1-b4b6-c1980c4ad221-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (7eeb55ac-d2ea-40bc-bbcf-647cd063d278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e969fc-b5cb-4246-b315-34943ff96305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e969fc-b5cb-4246-b315-34943ff96305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517484774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7967ecb3-35a2-4ddf-a113-8f76f068915f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:54Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82850daf-c141-4605-8abc-3c5ea4509169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82850daf-c141-4605-8abc-3c5ea4509169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5305be-da6e-43ed-8c0e-f2d57017cffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5305be-da6e-43ed-8c0e-f2d57017cffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7967ecb3-35a2-4ddf-a113-8f76f068915f', 'volume_name': 'volume-7967ecb3-35a2-4ddf-a113-8f76f068915f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb9c981-6455-45ad-9a67-ef1b76c889af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb9c981-6455-45ad-9a67-ef1b76c889af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b92b633-11ec-4425-a0ce-edb01f6f71bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:54 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Volume 7967ecb3-35a2-4ddf-a113-8f76f068915f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7967ecb3-35a2-4ddf-a113-8f76f068915f', 'volume_size': 1}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517484774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7967ecb3-35a2-4ddf-a113-8f76f068915f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:54Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Creating volume 7967ecb3-35a2-4ddf-a113-8f76f068915f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:54 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:54 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f 1073741824
Jul 31 15:05:54 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:54 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f 1073741824" returned: 0 in 0.402s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:54 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f
Jul 31 15:05:54 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:54 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f" returned: 0 in 0.243s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b92b633-11ec-4425-a0ce-edb01f6f71bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7967ecb3-35a2-4ddf-a113-8f76f068915f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0451fe7a-5924-45a5-9b49-a43515664ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:55 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Volume volume-7967ecb3-35a2-4ddf-a113-8f76f068915f (7967ecb3-35a2-4ddf-a113-8f76f068915f): created successfully
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0451fe7a-5924-45a5-9b49-a43515664ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (7eeb55ac-d2ea-40bc-bbcf-647cd063d278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:55 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-385ba59d-c83d-4968-87f4-807193d0833f tempest-ProjectReaderTests-1430932908 None] Created volume successfully.
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-7967ecb3-35a2-4ddf-a113-8f76f068915f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-7967ecb3-35a2-4ddf-a113-8f76f068915f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-quobyte-7967ecb3-35a2-4ddf-a113-8f76f068915f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-7967ecb3-35a2-4ddf-a113-8f76f068915f" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3b5ba-70e5-4997-9e6d-8196d432de52]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:55 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f
Jul 31 15:05:55 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:55 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f" returned: 0 in 0.343s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:55 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f
Jul 31 15:05:55 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:56 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7967ecb3-35a2-4ddf-a113-8f76f068915f" returned: 0 in 0.241s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-7967ecb3-35a2-4ddf-a113-8f76f068915f" released by "delete_volume" :: held 0.622s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Created reservations ['9e5ef7fb-4602-453f-bbf9-41a37d02f188', '340870d0-5535-4d38-ba4b-8a58074c264a', '6ac41da8-c05e-420a-9df8-b1da50d0675f', '806db782-e41d-491a-87c3-1bc78000895e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:56 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:56 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:56 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.236s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:56 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Deleted volume successfully.
Jul 31 15:05:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-ae0f0330-e100-41c3-97b0-1ce04d6b0c20 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-7967ecb3-35a2-4ddf-a113-8f76f068915f-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (5eaf386c-4efe-4ce2-88fa-4ff1c129d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f49749-3800-48aa-9a97-12783cb2bfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f49749-3800-48aa-9a97-12783cb2bfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329611334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f49ef7-3ef9-4950-a36f-6c97de8653d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:57Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbf3e7a-b38a-4d70-946a-cc7e79f9644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbf3e7a-b38a-4d70-946a-cc7e79f9644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cb0ce9-17f6-4fd1-8852-e901a23226af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cb0ce9-17f6-4fd1-8852-e901a23226af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f49ef7-3ef9-4950-a36f-6c97de8653d0', 'volume_name': 'volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b0d5c5-2398-4003-90b3-7478eaea8791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b0d5c5-2398-4003-90b3-7478eaea8791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0683f3de-12b0-4153-9181-f692e57b61e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Volume 87f49ef7-3ef9-4950-a36f-6c97de8653d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0', 'volume_size': 1}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329611334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f49ef7-3ef9-4950-a36f-6c97de8653d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:05:57Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Creating volume 87f49ef7-3ef9-4950-a36f-6c97de8653d0 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:57 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:57 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0 1073741824
Jul 31 15:05:57 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:57 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0 1073741824" returned: 0 in 0.382s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:57 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0
Jul 31 15:05:57 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:57 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0" returned: 0 in 0.236s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0683f3de-12b0-4153-9181-f692e57b61e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbb2862-de85-4364-a52a-433efa6416e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Volume volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0 (87f49ef7-3ef9-4950-a36f-6c97de8653d0): created successfully
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbb2862-de85-4364-a52a-433efa6416e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (5eaf386c-4efe-4ce2-88fa-4ff1c129d275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7fb9136a-b08c-4945-8fef-6e3e7410eddb tempest-ProjectReaderTests-1430932908 None] Created volume successfully.
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:58 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:58 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-87f49ef7-3ef9-4950-a36f-6c97de8653d0-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-87f49ef7-3ef9-4950-a36f-6c97de8653d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-quobyte-87f49ef7-3ef9-4950-a36f-6c97de8653d0" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-87f49ef7-3ef9-4950-a36f-6c97de8653d0" acquired by "delete_volume" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad4912c-436f-4d90-88c7-284ce2e3450c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:58 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.256s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:05:58 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0
Jul 31 15:05:58 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:58 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0" returned: 0 in 0.352s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:58 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0
Jul 31 15:05:58 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:58 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-87f49ef7-3ef9-4950-a36f-6c97de8653d0" returned: 0 in 0.244s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-87f49ef7-3ef9-4950-a36f-6c97de8653d0" released by "delete_volume" :: held 0.633s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=128,cinder:INSERT=34,cinder:SELECT=107,cinder:DELETE=10 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Created reservations ['3bae3131-f17a-421a-adc0-869a31a65892', 'be14cbd9-5695-4f3f-896e-3c42338c7c5c', '3346851b-7ea0-4ccc-94b3-f4a19e755784', '1cd5d2a4-6d3f-44b9-8bd7-eadc0b9ca9ea'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:58 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:05:58 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:05:59 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.241s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:05:59 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Deleted volume successfully.
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b517e7f0-1316-43f2-a8df-5940dace88c6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-87f49ef7-3ef9-4950-a36f-6c97de8653d0-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (a44e5b61-c501-493c-baf2-fd5d4a876969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65492883-c181-428e-bd5d-c579b643b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65492883-c181-428e-bd5d-c579b643b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899483500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74261ded-1592-4f85-8278-0083a38ce2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:00Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f430e3f-901f-4055-a38a-78b125ef3585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f430e3f-901f-4055-a38a-78b125ef3585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1528207d-731b-475f-84d1-dbdd3b2d692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1528207d-731b-475f-84d1-dbdd3b2d692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74261ded-1592-4f85-8278-0083a38ce2bc', 'volume_name': 'volume-74261ded-1592-4f85-8278-0083a38ce2bc', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b7b593-7ca2-4c08-8c82-60c6e3f7ad5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b7b593-7ca2-4c08-8c82-60c6e3f7ad5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45b54a3-6f8f-44c4-96fd-58a0146ddd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:05:59 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Volume 74261ded-1592-4f85-8278-0083a38ce2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74261ded-1592-4f85-8278-0083a38ce2bc', 'volume_size': 1}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899483500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74261ded-1592-4f85-8278-0083a38ce2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:00Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Creating volume 74261ded-1592-4f85-8278-0083a38ce2bc {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:05:59 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:05:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:05:59 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc 1073741824
Jul 31 15:05:59 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:00 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc 1073741824" returned: 0 in 0.395s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:00 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc
Jul 31 15:06:00 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:00 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc" returned: 0 in 0.238s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45b54a3-6f8f-44c4-96fd-58a0146ddd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74261ded-1592-4f85-8278-0083a38ce2bc', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7d1ba2-3f01-466a-a423-a94041461cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:00 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Volume volume-74261ded-1592-4f85-8278-0083a38ce2bc (74261ded-1592-4f85-8278-0083a38ce2bc): created successfully
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7d1ba2-3f01-466a-a423-a94041461cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (a44e5b61-c501-493c-baf2-fd5d4a876969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6bd44f1a-d820-41f4-b992-c1abc6f03715 tempest-ProjectReaderTests-1430932908 None] Created volume successfully.
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-74261ded-1592-4f85-8278-0083a38ce2bc-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-74261ded-1592-4f85-8278-0083a38ce2bc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-quobyte-74261ded-1592-4f85-8278-0083a38ce2bc" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-74261ded-1592-4f85-8278-0083a38ce2bc" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2123a-6bc6-4690-bc10-d4edfc41ed71]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:00 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc
Jul 31 15:06:00 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:01 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc" returned: 0 in 0.339s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:01 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc
Jul 31 15:06:01 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:01 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-74261ded-1592-4f85-8278-0083a38ce2bc" returned: 0 in 0.238s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-74261ded-1592-4f85-8278-0083a38ce2bc" released by "delete_volume" :: held 0.620s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Created reservations ['0e2dc8c0-5456-4041-8e79-7e75f1bf9146', '494b86ed-7846-4f69-ad72-dea2b3ccf083', 'cac6a127-464a-4310-a549-17ebc5f2b2c3', 'ec3948a0-5fb3-48f1-bb15-623df43aaf4c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:01 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:01 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:01 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.238s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:01 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Deleted volume successfully.
Jul 31 15:06:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-19568338-ecbc-4fda-9cd7-aa1c73c47df6 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-74261ded-1592-4f85-8278-0083a38ce2bc-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (c105030b-e124-4c89-818c-431123b08b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5679d8-7bcf-42b5-9b10-58c8996bea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5679d8-7bcf-42b5-9b10-58c8996bea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953980988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b877937f-132a-40c2-9ff6-c1dcbfcf3d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:02Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a8d18c-cc9b-44e2-9453-b12b7e76c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a8d18c-cc9b-44e2-9453-b12b7e76c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa5b22f-04c5-4efd-9b50-2cbb61ef5009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa5b22f-04c5-4efd-9b50-2cbb61ef5009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b877937f-132a-40c2-9ff6-c1dcbfcf3d19', 'volume_name': 'volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830370f8-f356-496b-87f2-e72ab4506537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830370f8-f356-496b-87f2-e72ab4506537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee76ac28-71d6-4de4-bf33-432fbd197013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:02 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Volume b877937f-132a-40c2-9ff6-c1dcbfcf3d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19', 'volume_size': 1}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953980988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b877937f-132a-40c2-9ff6-c1dcbfcf3d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eba0b698c14081bb8353dca4da5bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:02Z,use_quota=True,user_id='42f300d3b87f42ae858574c4d1f46bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Creating volume b877937f-132a-40c2-9ff6-c1dcbfcf3d19 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:02 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:02 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19 1073741824
Jul 31 15:06:02 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:02 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19 1073741824" returned: 0 in 0.429s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:02 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19
Jul 31 15:06:02 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:03 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee76ac28-71d6-4de4-bf33-432fbd197013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553b8307-2b78-40ac-8f45-a74e2c4306c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:03 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Volume volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19 (b877937f-132a-40c2-9ff6-c1dcbfcf3d19): created successfully
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553b8307-2b78-40ac-8f45-a74e2c4306c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Flow 'volume_create_manager' (c105030b-e124-4c89-818c-431123b08b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:03 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-99b47ed6-87da-43b3-b83a-cade8d5e9b58 tempest-ProjectReaderTests-1430932908 None] Created volume successfully.
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-b877937f-132a-40c2-9ff6-c1dcbfcf3d19-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-b877937f-132a-40c2-9ff6-c1dcbfcf3d19-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "cinder-quobyte-b877937f-132a-40c2-9ff6-c1dcbfcf3d19" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-b877937f-132a-40c2-9ff6-c1dcbfcf3d19" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2132c9e0-b374-4224-9a6a-c1f936395a72]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:03 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19
Jul 31 15:06:03 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:03 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19" returned: 0 in 0.351s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:03 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19
Jul 31 15:06:03 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:03 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b877937f-132a-40c2-9ff6-c1dcbfcf3d19" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-quobyte-b877937f-132a-40c2-9ff6-c1dcbfcf3d19" released by "delete_volume" :: held 0.641s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Created reservations ['17d7cdda-efe0-4431-9a8f-0f9634dfbc0e', 'cc509e95-a6bf-4e35-bc0d-405036be4342', '06a49a6f-2e0b-45e2-a2c9-3bc3863bac20', '698c0272-39b6-4929-b820-719090c531a5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:04 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:04 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:04 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.256s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Deleted volume successfully.
Jul 31 15:06:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-28720236-be6c-4cb6-acab-9299b0b5f873 tempest-ProjectReaderTests-1430932908 None] Lock "cinder-b877937f-132a-40c2-9ff6-c1dcbfcf3d19-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:14 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=147,cinder:SELECT=93,cinder:INSERT=43,cinder:DELETE=12 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:06:14 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:DELETE=4,cinder:INSERT=4 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (e4b78658-917d-4c41-bccb-2d8ba6252981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c32225-12bb-462b-807d-29bce9be5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c32225-12bb-462b-807d-29bce9be5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163497051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb26d85e-d29a-46ff-b147-2f1b1849392e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:17Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b105e546-c606-4557-88e8-eed13fc5fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b105e546-c606-4557-88e8-eed13fc5fd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cf2e1d-be69-4ced-b5c4-617ef344d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cf2e1d-be69-4ced-b5c4-617ef344d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb26d85e-d29a-46ff-b147-2f1b1849392e', 'volume_name': 'volume-eb26d85e-d29a-46ff-b147-2f1b1849392e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a6214-5df7-4918-a3d9-9b933cf6651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a6214-5df7-4918-a3d9-9b933cf6651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6520b7-733b-429c-9806-6cff30725284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:16 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Volume eb26d85e-d29a-46ff-b147-2f1b1849392e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb26d85e-d29a-46ff-b147-2f1b1849392e', 'volume_size': 1}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163497051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb26d85e-d29a-46ff-b147-2f1b1849392e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:17Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Creating volume eb26d85e-d29a-46ff-b147-2f1b1849392e {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:16 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:16 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e 1073741824
Jul 31 15:06:16 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Flow 'volume_create_manager' (a6583d1b-e0f3-45cb-a866-932b6ceaf394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f551dd6a-2df2-46df-87a1-2a4177b6a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e 1073741824" returned: 0 in 0.549s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f551dd6a-2df2-46df-87a1-2a4177b6a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1597769492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387e87ab-15c2-4b27-a9a8-c662e6a34c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0996c7680b0435795860f4f91b78eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:17Z,use_quota=True,user_id='70df8b84124a4ec8a29f885e769e2f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229ac382-c741-4da4-b1aa-79ae26a0c7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229ac382-c741-4da4-b1aa-79ae26a0c7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795fdcc2-8855-45ff-b030-98a6cae3971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795fdcc2-8855-45ff-b030-98a6cae3971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387e87ab-15c2-4b27-a9a8-c662e6a34c34', 'volume_name': 'volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72e91d6-7ed1-47f2-b7f3-fda5ae90db63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72e91d6-7ed1-47f2-b7f3-fda5ae90db63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7792e15e-0b73-4a65-b099-a6a591068d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Volume 387e87ab-15c2-4b27-a9a8-c662e6a34c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34', 'volume_size': 1}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:17 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e
Jul 31 15:06:17 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (d78b4b81-07f7-4de8-8718-e0261d872523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fdf295-fb1a-464d-a6f0-b4b977646475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fdf295-fb1a-464d-a6f0-b4b977646475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117239307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56ae91f-e4b0-4695-af5e-9e83e540275a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:17Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bba4627-c2a2-4f29-bf55-0b830ee25bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bba4627-c2a2-4f29-bf55-0b830ee25bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec1bb33-8a79-46dc-9890-888d0f96b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec1bb33-8a79-46dc-9890-888d0f96b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56ae91f-e4b0-4695-af5e-9e83e540275a', 'volume_name': 'volume-a56ae91f-e4b0-4695-af5e-9e83e540275a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72160ec-e063-48f3-80e8-54f58f0f3db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72160ec-e063-48f3-80e8-54f58f0f3db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5128aff2-a4bc-416b-8b3e-e3a676b24fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Volume a56ae91f-e4b0-4695-af5e-9e83e540275a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56ae91f-e4b0-4695-af5e-9e83e540275a', 'volume_size': 1}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e" returned: 0 in 0.374s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1597769492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387e87ab-15c2-4b27-a9a8-c662e6a34c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0996c7680b0435795860f4f91b78eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:17Z,use_quota=True,user_id='70df8b84124a4ec8a29f885e769e2f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Creating volume 387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:17 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6520b7-733b-429c-9806-6cff30725284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb26d85e-d29a-46ff-b147-2f1b1849392e', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b34a85-4aa1-4255-bb9a-898efb075b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:17 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 1073741824
Jul 31 15:06:17 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:17 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Volume volume-eb26d85e-d29a-46ff-b147-2f1b1849392e (eb26d85e-d29a-46ff-b147-2f1b1849392e): created successfully
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b34a85-4aa1-4255-bb9a-898efb075b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (e4b78658-917d-4c41-bccb-2d8ba6252981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2a1e2ba6-0380-43ea-9bc3-c201e598ec07 tempest-CreateVolumesFromImageTest-312177214 None] Created volume successfully.
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Flow 'volume_create_manager' (7ad9ced5-6798-45c5-987e-107295a46567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2965bc6-dc4f-427d-b12f-4213e6b689f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2965bc6-dc4f-427d-b12f-4213e6b689f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02faa8a-1dbf-4574-9e27-b0e80d7fdec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a986ed5c37461f8517fc1a06bcaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='936d685fea3c41d1a95d87b0ae46bdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f9efb5-47ea-4ff9-93e1-4f1b388bc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f9efb5-47ea-4ff9-93e1-4f1b388bc38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab8461a-a9e1-4e02-9cdb-c770f0fdae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab8461a-a9e1-4e02-9cdb-c770f0fdae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02faa8a-1dbf-4574-9e27-b0e80d7fdec0', 'volume_name': 'volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d288128-dcb0-4dcc-864a-da91ddbde2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d288128-dcb0-4dcc-864a-da91ddbde2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527e46d4-a838-44e6-aec1-4848a3011f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Volume a02faa8a-1dbf-4574-9e27-b0e80d7fdec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0', 'volume_size': 1}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (15281619-76a0-4206-b74a-5187cceed1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e053719-8e48-4bd2-adcc-119788337929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (8df9567f-a048-43d3-a38d-8a05c8c08278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97039465-10f7-46ff-8603-7378452ce49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e053719-8e48-4bd2-adcc-119788337929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467886691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84e3352-a3b4-4592-8e1c-c393f23563dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84e3352-a3b4-4592-8e1c-c393f23563dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fd892a-7f80-421c-9d93-6b529208b35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fd892a-7f80-421c-9d93-6b529208b35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f', 'volume_name': 'volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83db1c45-bbd3-4bee-a56c-405cbfd0b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83db1c45-bbd3-4bee-a56c-405cbfd0b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d2eaa6-eb0a-49f0-8318-a5c3984c0be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Volume 2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f', 'volume_size': 1}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97039465-10f7-46ff-8603-7378452ce49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340415879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf87af51-ba5d-4b18-8666-108eaa3435c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43ba380-b0c8-4db9-8559-6cb05b9ff985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43ba380-b0c8-4db9-8559-6cb05b9ff985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9ca185-6746-475e-a93b-0dd89cc1d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9ca185-6746-475e-a93b-0dd89cc1d682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf87af51-ba5d-4b18-8666-108eaa3435c6', 'volume_name': 'volume-cf87af51-ba5d-4b18-8666-108eaa3435c6', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb34b31-1acc-46e0-90db-f047f5a4eec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb34b31-1acc-46e0-90db-f047f5a4eec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1635eb6-5d71-44f0-9e51-bbbc3983771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Volume cf87af51-ba5d-4b18-8666-108eaa3435c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf87af51-ba5d-4b18-8666-108eaa3435c6', 'volume_size': 1}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (5c18f994-d3d1-4355-893d-84bc95527738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfe960f-210b-4f18-97cb-dba2045f84aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 1073741824" returned: 0 in 0.714s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfe960f-210b-4f18-97cb-dba2045f84aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244655481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94a6de4-d9d3-4f20-8911-9ad4870608ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59c703d-8da5-458d-b25c-ca142951e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59c703d-8da5-458d-b25c-ca142951e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78995a96-f2c5-4f5f-900e-4e0e6d8d89b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78995a96-f2c5-4f5f-900e-4e0e6d8d89b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94a6de4-d9d3-4f20-8911-9ad4870608ec', 'volume_name': 'volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3b4995-2575-4f9c-a1a9-58ca8547311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3b4995-2575-4f9c-a1a9-58ca8547311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed776a4e-3b97-41da-8e52-cc56430cf583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Volume b94a6de4-d9d3-4f20-8911-9ad4870608ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec', 'volume_size': 1}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:18 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34
Jul 31 15:06:18 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:18 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117239307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56ae91f-e4b0-4695-af5e-9e83e540275a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:17Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Creating volume a56ae91f-e4b0-4695-af5e-9e83e540275a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:18 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7792e15e-0b73-4a65-b099-a6a591068d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fe98ec-b27d-4edd-96ae-b18d6bb398d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:18 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a 1073741824
Jul 31 15:06:18 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Volume volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 (387e87ab-15c2-4b27-a9a8-c662e6a34c34): created successfully
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fe98ec-b27d-4edd-96ae-b18d6bb398d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Flow 'volume_create_manager' (a6583d1b-e0f3-45cb-a866-932b6ceaf394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c7e34dd4-1b75-4c84-b976-7cd0a33c105c tempest-VolumeDependencyTests-769150457 None] Created volume successfully.
Jul 31 15:06:19 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a 1073741824" returned: 0 in 0.477s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:19 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a
Jul 31 15:06:19 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:19 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.399s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02faa8a-1dbf-4574-9e27-b0e80d7fdec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a986ed5c37461f8517fc1a06bcaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='936d685fea3c41d1a95d87b0ae46bdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Creating volume a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:19 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:19 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 1073741824
Jul 31 15:06:19 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5128aff2-a4bc-416b-8b3e-e3a676b24fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56ae91f-e4b0-4695-af5e-9e83e540275a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7a6379-7d07-4ca7-bff7-f6379fa60902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:19 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Volume volume-a56ae91f-e4b0-4695-af5e-9e83e540275a (a56ae91f-e4b0-4695-af5e-9e83e540275a): created successfully
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7a6379-7d07-4ca7-bff7-f6379fa60902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (d78b4b81-07f7-4de8-8718-e0261d872523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:19 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-294048ed-2c7d-40bb-b5e0-7692ed0d92e0 tempest-CreateVolumesFromImageTest-312177214 None] Created volume successfully.
Jul 31 15:06:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:20 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 1073741824" returned: 0 in 0.497s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:20 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0
Jul 31 15:06:20 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:20 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.085s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467886691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Creating volume 2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:20 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:20 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f 1073741824
Jul 31 15:06:20 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527e46d4-a838-44e6-aec1-4848a3011f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0e8d14-9490-4a71-8299-89dc32243867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:20 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Volume volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 (a02faa8a-1dbf-4574-9e27-b0e80d7fdec0): created successfully
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0e8d14-9490-4a71-8299-89dc32243867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Flow 'volume_create_manager' (7ad9ced5-6798-45c5-987e-107295a46567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-968c1e1a-5db7-4d1c-8840-951abbd1d55a tempest-CinderUnicodeTest-1994183188 None] Created volume successfully.
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Flow 'volume_create_manager' (1cc42833-2f3c-4735-b8b6-fff96bd7b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e1d98c-582f-482b-9029-0125f0ceb0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e1d98c-582f-482b-9029-0125f0ceb0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b1044b-044f-410a-8ffb-70820cb73bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0879425c28b4ea6a469b216e824b1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:21Z,use_quota=True,user_id='1aca3857059d4ec8ba2c7e1de7c0987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5eed6d7-a719-4391-b6b7-37c575dc8258),volume_type_id=a5eed6d7-a719-4391-b6b7-37c575dc8258)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d52cb0-6b05-4b45-9784-0b77eff94786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d52cb0-6b05-4b45-9784-0b77eff94786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c199ec7-3174-465c-8691-1ee019ea79d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:06:20 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f 1073741824" returned: 0 in 0.453s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:21 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f
Jul 31 15:06:21 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c199ec7-3174-465c-8691-1ee019ea79d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7b1044b-044f-410a-8ffb-70820cb73bab', 'volume_name': 'volume-c7b1044b-044f-410a-8ffb-70820cb73bab', 'volume_size': 1, 'image_id': '09c0290c-ae61-4542-8116-02b2a16d512e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09c0290c-ae61-4542-8116-02b2a16d512e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a604ff816d2c0e9afbe2c60d3cf4125', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c0879425c28b4ea6a469b216e824b1bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10fcc90a436a12d678c6b9b0492f4893612085163968dea47556b8726725ced2d8288275f234fcffe8069b8493a42e27b451e3328623fbdc67878341dd367e1d', 'id': '09c0290c-ae61-4542-8116-02b2a16d512e', 'created_at': datetime.datetime(2026, 7, 31, 13, 6, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 6, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09c0290c-ae61-4542-8116-02b2a16d512e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe487a120>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9750f44b-cba7-4eee-aee8-614b944d966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9750f44b-cba7-4eee-aee8-614b944d966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6c871e-d94a-4187-b9a2-9f82c65aab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Volume c7b1044b-044f-410a-8ffb-70820cb73bab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7b1044b-044f-410a-8ffb-70820cb73bab', 'volume_size': 1, 'image_id': '09c0290c-ae61-4542-8116-02b2a16d512e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09c0290c-ae61-4542-8116-02b2a16d512e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a604ff816d2c0e9afbe2c60d3cf4125', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c0879425c28b4ea6a469b216e824b1bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10fcc90a436a12d678c6b9b0492f4893612085163968dea47556b8726725ced2d8288275f234fcffe8069b8493a42e27b451e3328623fbdc67878341dd367e1d', 'id': '09c0290c-ae61-4542-8116-02b2a16d512e', 'created_at': datetime.datetime(2026, 7, 31, 13, 6, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 6, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09c0290c-ae61-4542-8116-02b2a16d512e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe487a120>}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Trying to clone c7b1044b-044f-410a-8ffb-70820cb73bab from image 09c0290c-ae61-4542-8116-02b2a16d512e at location (None, [{'url': 'file:///opt/stack/data/glance/images/09c0290c-ae61-4542-8116-02b2a16d512e', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:06:21 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.791s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340415879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf87af51-ba5d-4b18-8666-108eaa3435c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Creating volume cf87af51-ba5d-4b18-8666-108eaa3435c6 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:21 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:06:21 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Image download 0.00 MB at 0.00 MB/s
Jul 31 15:06:21 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6 1073741824
Jul 31 15:06:21 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d2eaa6-eb0a-49f0-8318-a5c3984c0be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4f223-ccf3-49e6-992b-08625e1fc0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Volume volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f (2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f): created successfully
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4f223-ccf3-49e6-992b-08625e1fc0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (15281619-76a0-4206-b74a-5187cceed1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54717b5-f7d9-4c8e-9113-69b9fdc53ee7]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-786ed551-ae83-456f-bc7f-cb662c867359 tempest-CreateVolumesFromImageTest-312177214 None] Created volume successfully.
Jul 31 15:06:21 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD
Jul 31 15:06:21 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:21 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:21 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6 1073741824" returned: 0 in 0.533s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:21 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD
Jul 31 15:06:21 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:21 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6
Jul 31 15:06:21 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Flow 'volume_create_manager' (a9a166a8-ec1e-4eb3-9301-a55fb3b24978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e72c5cb-6f14-4149-b437-b459d2a85e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e72c5cb-6f14-4149-b437-b459d2a85e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1306243422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd70e08-335f-4635-ac60-b0e0a88ab4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a986ed5c37461f8517fc1a06bcaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:22Z,use_quota=True,user_id='936d685fea3c41d1a95d87b0ae46bdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e792febd-7ef0-4ea3-ba9c-ab42c5309dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e792febd-7ef0-4ea3-ba9c-ab42c5309dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b403b71e-2e8a-48c9-8273-ce545b698fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b403b71e-2e8a-48c9-8273-ce545b698fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd70e08-335f-4635-ac60-b0e0a88ab4a3', 'volume_name': 'volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7fb24e-491b-452c-98f1-675cdbeaec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7fb24e-491b-452c-98f1-675cdbeaec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298905d7-4b2a-4a90-911d-5c8a776208dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:21 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Volume 9fd70e08-335f-4635-ac60-b0e0a88ab4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3', 'volume_size': 1}
Jul 31 15:06:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:22 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:22 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244655481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94a6de4-d9d3-4f20-8911-9ad4870608ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dafe2897324e3ea193f97ba2f95636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:18Z,use_quota=True,user_id='3a93126df1e949619cd99a1d3744caf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Creating volume b94a6de4-d9d3-4f20-8911-9ad4870608ec {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:22 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Temporary image 09c0290c-ae61-4542-8116-02b2a16d512e is fetched for user 1aca3857059d4ec8ba2c7e1de7c0987d. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1635eb6-5d71-44f0-9e51-bbbc3983771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf87af51-ba5d-4b18-8666-108eaa3435c6', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:22 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec 1073741824
Jul 31 15:06:22 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b88ce6d-7cee-4fc1-8f98-84d6f7b70046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:22 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Volume volume-cf87af51-ba5d-4b18-8666-108eaa3435c6 (cf87af51-ba5d-4b18-8666-108eaa3435c6): created successfully
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b88ce6d-7cee-4fc1-8f98-84d6f7b70046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (8df9567f-a048-43d3-a38d-8a05c8c08278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-743e00d5-0501-4f51-95b2-b82e9177fd57 tempest-CreateVolumesFromImageTest-312177214 None] Created volume successfully.
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b6286-dbcc-4d13-ba8b-b49daa2210e5]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:22 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD
Jul 31 15:06:22 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:22 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec 1073741824" returned: 0 in 0.438s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:22 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:22 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec
Jul 31 15:06:22 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:22 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD
Jul 31 15:06:22 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:22 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.931s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed776a4e-3b97-41da-8e52-cc56430cf583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b88a485-8ac3-4053-9a0a-63e98bafe7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Creating offline snapshot 8a1c1c97-b1ce-4edb-97b6-812e6d436a23 of volume 387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:06:22 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2dafeb-9bfd-4dc3-b9c4-e73478c24695]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:22 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Volume volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec (b94a6de4-d9d3-4f20-8911-9ad4870608ec): created successfully
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b88a485-8ac3-4053-9a0a-63e98bafe7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Flow 'volume_create_manager' (5c18f994-d3d1-4355-893d-84bc95527738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:06:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-92c4e285-046d-453f-a19b-255af69eae17 tempest-CreateVolumesFromImageTest-312177214 None] Created volume successfully.
Jul 31 15:06:23 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34
Jul 31 15:06:23 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:23 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34" returned: 0 in 0.397s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:23 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 1G
Jul 31 15:06:23 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:23 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-b94a6de4-d9d3-4f20-8911-9ad4870608ec-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 1G" returned: 0 in 0.410s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-b94a6de4-d9d3-4f20-8911-9ad4870608ec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:23 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23
Jul 31 15:06:23 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-quobyte-b94a6de4-d9d3-4f20-8911-9ad4870608ec" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-b94a6de4-d9d3-4f20-8911-9ad4870608ec" acquired by "delete_volume" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c917805-66e8-4c45-8af1-81f6396c09d8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:23 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec
Jul 31 15:06:23 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:24 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:24 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 is being set with open permissions: ugo+rw
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:24 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23
Jul 31 15:06:24 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:24 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec" returned: 0 in 0.379s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:24 devstack sudo[107606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec
Jul 31 15:06:24 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:24 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23" returned: 0 in 0.249s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:24 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.info
Jul 31 15:06:24 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:24 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b94a6de4-d9d3-4f20-8911-9ad4870608ec" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-b94a6de4-d9d3-4f20-8911-9ad4870608ec" released by "delete_volume" :: held 0.687s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Created reservations ['14e31635-b89d-4f13-bb0b-1b325baf9d8d', '124ba93e-5dd7-4686-bd8e-54f24d92440e', 'bff49d95-cfdb-4262-ac47-4ad4be229cf4', '46999290-a119-4c2e-8d4f-8f0ca5271454'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:24 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.info" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:24 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.info is being set with open permissions: ugo+rw
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:24 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.info
Jul 31 15:06:24 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:24 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:24 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:24 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.info" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.928s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1306243422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd70e08-335f-4635-ac60-b0e0a88ab4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a986ed5c37461f8517fc1a06bcaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:22Z,use_quota=True,user_id='936d685fea3c41d1a95d87b0ae46bdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Creating volume 9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:24 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:24 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:24 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 1073741824
Jul 31 15:06:24 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.329s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:24 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Deleted volume successfully.
Jul 31 15:06:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:24 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b05108bb-a83c-4eac-a03b-e73631204a0e tempest-VolumeDependencyTests-769150457 None] Create snapshot completed successfully
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-376bbac7-5929-4dd8-ad03-fc55d3e37a71 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-b94a6de4-d9d3-4f20-8911-9ad4870608ec-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-quobyte-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44b8aef-1cda-4864-8054-faa6b06f7e74]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:25 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f
Jul 31 15:06:25 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:25 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 1073741824" returned: 0 in 0.492s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:25 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3
Jul 31 15:06:25 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:25 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f" returned: 0 in 0.441s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:25 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f
Jul 31 15:06:25 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:25 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" returned: 0 in 0.301s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.782s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b1044b-044f-410a-8ffb-70820cb73bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0879425c28b4ea6a469b216e824b1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:21Z,use_quota=True,user_id='1aca3857059d4ec8ba2c7e1de7c0987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5eed6d7-a719-4391-b6b7-37c575dc8258),volume_type_id=a5eed6d7-a719-4391-b6b7-37c575dc8258)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Creating volume c7b1044b-044f-410a-8ffb-70820cb73bab {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:25 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:25 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab 1073741824
Jul 31 15:06:25 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298905d7-4b2a-4a90-911d-5c8a776208dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f694263-183b-4320-944d-ccd85b4fe8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Volume volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 (9fd70e08-335f-4635-ac60-b0e0a88ab4a3): created successfully
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f694263-183b-4320-944d-ccd85b4fe8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:25 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Flow 'volume_create_manager' (a9a166a8-ec1e-4eb3-9301-a55fb3b24978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5035522c-e083-4e7f-8ff9-760d37c4f7db tempest-CinderUnicodeTest-1994183188 None] Created volume successfully.
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f" released by "delete_volume" :: held 0.811s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Flow 'volume_create_manager' (215b32c7-a00d-4944-91c7-4d7c81e5942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d26da2b-aa9d-4fbd-a836-69749015190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d26da2b-aa9d-4fbd-a836-69749015190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-428410071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b747c00-5c7b-40ab-bc9e-e1db6a41f246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0996c7680b0435795860f4f91b78eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a1c1c97-b1ce-4edb-97b6-812e6d436a23,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:26Z,use_quota=True,user_id='70df8b84124a4ec8a29f885e769e2f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ce6880-4731-4366-962c-24c472f16bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ce6880-4731-4366-962c-24c472f16bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd223bc-99d2-4991-9074-651a46ac66df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd223bc-99d2-4991-9074-651a46ac66df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b747c00-5c7b-40ab-bc9e-e1db6a41f246', 'volume_name': 'volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246', 'volume_size': 1, 'snapshot_id': '8a1c1c97-b1ce-4edb-97b6-812e6d436a23'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddb3422-f6cc-4cc6-a0cc-708f63174586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddb3422-f6cc-4cc6-a0cc-708f63174586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d00f43a-0208-41fd-93d1-f8341b48ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Volume 3b747c00-5c7b-40ab-bc9e-e1db6a41f246: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246', 'volume_size': 1, 'snapshot_id': '8a1c1c97-b1ce-4edb-97b6-812e6d436a23'}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:25 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Created reservations ['207acc59-2dad-43a1-a6fd-75ade0600539', '7db2ba3d-cd8f-46a5-8188-cae7bcbcf71d', 'a3187974-995f-4578-b900-566736daa6bd', '3a0c5d3f-302e-44f9-bab6-a5d90ca552a5'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:26 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:26 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:26 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab 1073741824" returned: 0 in 0.532s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:26 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab
Jul 31 15:06:26 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:26 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:26 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Deleted volume successfully.
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d83cbf72-23fa-48b7-8231-aee724fd49bd tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-2ecd7d3d-4027-4a6c-85ff-7311eaa5d53f-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:26 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab" returned: 0 in 0.282s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.643s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-quobyte-8a1c1c97-b1ce-4edb-97b6-812e6d436a23-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-8a1c1c97-b1ce-4edb-97b6-812e6d436a23-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Creating volume 3b747c00-5c7b-40ab-bc9e-e1db6a41f246 from snapshot 8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-quobyte-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Attempting download of 09c0290c-ae61-4542-8116-02b2a16d512e ((None, [{'url': 'file:///opt/stack/data/glance/images/09c0290c-ae61-4542-8116-02b2a16d512e', 'metadata': {}}])) to volume c7b1044b-044f-410a-8ffb-70820cb73bab. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] snapshot: 8a1c1c97-b1ce-4edb-97b6-812e6d436a23, volume: 3b747c00-5c7b-40ab-bc9e-e1db6a41f246,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c9a631-6278-4f22-bbd2-0d8e851f9545]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb05f61d-82e1-41ce-9076-5a38b4368765]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09c0290c-ae61-4542-8116-02b2a16d512e_2fk7_0tb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:26 devstack sudo[107654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23
Jul 31 15:06:26 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:26 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09c0290c-ae61-4542-8116-02b2a16d512e_2fk7_0tb
Jul 31 15:06:26 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09c0290c-ae61-4542-8116-02b2a16d512e_2fk7_0tb" returned: 0 in 0.325s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c0290c-ae61-4542-8116-02b2a16d512e_2fk7_0tb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:27 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23" returned: 0 in 0.356s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[998beb9d-651d-442d-89ed-8513b16b83ad]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-cf87af51-ba5d-4b18-8666-108eaa3435c6-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-cf87af51-ba5d-4b18-8666-108eaa3435c6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:27 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c0290c-ae61-4542-8116-02b2a16d512e_2fk7_0tb
Jul 31 15:06:27 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-quobyte-cf87af51-ba5d-4b18-8666-108eaa3435c6" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-cf87af51-ba5d-4b18-8666-108eaa3435c6" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:27 devstack sudo[107664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34
Jul 31 15:06:27 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a7a17c-4aec-4668-94a5-d3bd1a80b9f8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:27 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6
Jul 31 15:06:27 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c0290c-ae61-4542-8116-02b2a16d512e_2fk7_0tb" returned: 1 in 0.366s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c0290c-ae61-4542-8116-02b2a16d512e_2fk7_0tb' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b734a72-7faa-49ad-a83b-44f1fd942070]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:27 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34" returned: 0 in 0.449s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:27 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD
Jul 31 15:06:27 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246
Jul 31 15:06:27 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6" returned: 0 in 0.395s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:27 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6
Jul 31 15:06:27 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:27 devstack sudo[107688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD
Jul 31 15:06:27 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:27 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf87af51-ba5d-4b18-8666-108eaa3435c6" returned: 0 in 0.286s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-cf87af51-ba5d-4b18-8666-108eaa3435c6" released by "delete_volume" :: held 0.727s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Created reservations ['c2ce836b-2c0b-4e71-baad-c5e9be571c06', '1a6b447e-29ba-418b-b36a-e5d97d3f7215', 'ab26f57e-1d56-40bc-b84c-b5a9c31a01a5', '25c891a1-e8b2-4a90-b106-1e6783732f3c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:28 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:28 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:28 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD" returned: 1 in 0.577s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] 09c0290c-ae61-4542-8116-02b2a16d512e was raw, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:28 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab
Jul 31 15:06:28 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-a56ae91f-e4b0-4695-af5e-9e83e540275a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-a56ae91f-e4b0-4695-af5e-9e83e540275a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-quobyte-a56ae91f-e4b0-4695-af5e-9e83e540275a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-a56ae91f-e4b0-4695-af5e-9e83e540275a" acquired by "delete_volume" :: waited 0.047s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0eabd8-b209-4541-af2b-d6d59f4b5b50]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:28 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.763s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:28 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:28 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Deleted volume successfully.
Jul 31 15:06:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bd323da3-9a25-4b1d-8291-0bc59c1593f1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-cf87af51-ba5d-4b18-8666-108eaa3435c6-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:29 devstack sudo[107707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a
Jul 31 15:06:29 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:29 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a" returned: 0 in 0.915s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:29 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab" returned: 0 in 1.399s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:29 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09c0290c-ae61-4542-8116-02b2a16d512e_xkf2a4bedevstack@QuobyteHD, size 0.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:06:29 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Converted 0.00 MB image at 0.00 MB/s
Jul 31 15:06:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:29 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a
Jul 31 15:06:29 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:29 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab 1G
Jul 31 15:06:29 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:30 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a56ae91f-e4b0-4695-af5e-9e83e540275a" returned: 0 in 0.654s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-a56ae91f-e4b0-4695-af5e-9e83e540275a" released by "delete_volume" :: held 1.682s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Created reservations ['7d20e4fd-5309-4a3f-be01-74c650ada65f', '7be0dad7-b7c5-4340-8228-568f6787c3c9', '1525eb47-2b0c-4d86-8e95-87b96697ac70', '69baf83b-70c6-4813-bcff-4e3c987fbc15'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:30 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab 1G" returned: 0 in 0.848s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Downloaded image 09c0290c-ae61-4542-8116-02b2a16d512e ((None, [{'url': 'file:///opt/stack/data/glance/images/09c0290c-ae61-4542-8116-02b2a16d512e', 'metadata': {}}])) to volume c7b1044b-044f-410a-8ffb-70820cb73bab successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Temporary image 09c0290c-ae61-4542-8116-02b2a16d512e for user 1aca3857059d4ec8ba2c7e1de7c0987d is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Marking volume c7b1044b-044f-410a-8ffb-70820cb73bab as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Copying metadata from image 09c0290c-ae61-4542-8116-02b2a16d512e to c7b1044b-044f-410a-8ffb-70820cb73bab. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Creating volume glance metadata for volume c7b1044b-044f-410a-8ffb-70820cb73bab backed by image 09c0290c-ae61-4542-8116-02b2a16d512e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '09c0290c-ae61-4542-8116-02b2a16d512e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6a604ff816d2c0e9afbe2c60d3cf4125', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:30 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:30 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6c871e-d94a-4187-b9a2-9f82c65aab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b1044b-044f-410a-8ffb-70820cb73bab', 'volume_size': 1, 'image_id': '09c0290c-ae61-4542-8116-02b2a16d512e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09c0290c-ae61-4542-8116-02b2a16d512e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a604ff816d2c0e9afbe2c60d3cf4125', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c0879425c28b4ea6a469b216e824b1bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10fcc90a436a12d678c6b9b0492f4893612085163968dea47556b8726725ced2d8288275f234fcffe8069b8493a42e27b451e3328623fbdc67878341dd367e1d', 'id': '09c0290c-ae61-4542-8116-02b2a16d512e', 'created_at': datetime.datetime(2026, 7, 31, 13, 6, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 6, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09c0290c-ae61-4542-8116-02b2a16d512e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbe487a120>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004e848b-0e21-46ed-9451-afaf71151bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Volume volume-c7b1044b-044f-410a-8ffb-70820cb73bab (c7b1044b-044f-410a-8ffb-70820cb73bab): created successfully
Jul 31 15:06:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004e848b-0e21-46ed-9451-afaf71151bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Flow 'volume_create_manager' (1cc42833-2f3c-4735-b8b6-fff96bd7b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7e40864a-b684-4e6c-8da7-2dc11ccecefd tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Created volume successfully.
Jul 31 15:06:31 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.455s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Deleted volume successfully.
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-bbcbd4db-3bfd-4b34-84bd-a746c3a53eb1 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-a56ae91f-e4b0-4695-af5e-9e83e540275a-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-eb26d85e-d29a-46ff-b147-2f1b1849392e-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-eb26d85e-d29a-46ff-b147-2f1b1849392e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "cinder-quobyte-eb26d85e-d29a-46ff-b147-2f1b1849392e" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-eb26d85e-d29a-46ff-b147-2f1b1849392e" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71aba32-b7ff-4d70-9b96-0af289d576d0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Acquiring lock "cinder-c7b1044b-044f-410a-8ffb-70820cb73bab-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "cinder-c7b1044b-044f-410a-8ffb-70820cb73bab-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:32 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e
Jul 31 15:06:32 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Acquiring lock "cinder-quobyte-c7b1044b-044f-410a-8ffb-70820cb73bab" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "cinder-quobyte-c7b1044b-044f-410a-8ffb-70820cb73bab" acquired by "delete_volume" :: waited 0.045s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[388abc0e-9fc6-487e-899a-fc29a869198b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:32 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:32 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab
Jul 31 15:06:32 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e" returned: 0 in 0.628s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:32 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e
Jul 31 15:06:32 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:32 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" returned: 0 in 5.307s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:06:32 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Converted 1024.00 MB image at 192.91 MB/s
Jul 31 15:06:32 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 is being set with open permissions: ugo+rw
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:32 devstack sudo[107737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246
Jul 31 15:06:32 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:32 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-eb26d85e-d29a-46ff-b147-2f1b1849392e" returned: 0 in 0.392s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:33 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-quobyte-eb26d85e-d29a-46ff-b147-2f1b1849392e" released by "delete_volume" :: held 1.125s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab" returned: 0 in 0.677s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:33 devstack sudo[107743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab
Jul 31 15:06:33 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Created reservations ['42fa50e7-2d3c-445a-8b7b-e3e50f5702fc', '27a0d3db-29ae-4929-9cb6-28c4f167ee48', '01c68b84-1cf1-47f7-b5cc-bbbc3886dc35', '2f259a7a-89b5-41a0-b81b-89efd2e14c91'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:33 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" released by "_copy_volume_from_snapshot" :: held 6.475s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-8a1c1c97-b1ce-4edb-97b6-812e6d436a23-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" released by "_create_volume_from_snapshot" :: held 6.570s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.589s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:33 devstack sudo[107746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:33 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.788s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Creating offline snapshot 1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 of volume 9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d00f43a-0208-41fd-93d1-f8341b48ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246', 'volume_size': 1, 'snapshot_id': '8a1c1c97-b1ce-4edb-97b6-812e6d436a23'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f30d7f4-c4af-4045-b1ea-8ab15233fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a8b49c-79e5-405e-9a68-b8d57c782ed2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:33 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Volume volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 (3b747c00-5c7b-40ab-bc9e-e1db6a41f246): created successfully
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f30d7f4-c4af-4045-b1ea-8ab15233fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Flow 'volume_create_manager' (215b32c7-a00d-4944-91c7-4d7c81e5942f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9a3ae1de-7556-421e-98d8-0e2df8141550 tempest-VolumeDependencyTests-769150457 None] Created volume successfully.
Jul 31 15:06:33 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c7b1044b-044f-410a-8ffb-70820cb73bab" returned: 0 in 0.305s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "cinder-quobyte-c7b1044b-044f-410a-8ffb-70820cb73bab" released by "delete_volume" :: held 1.081s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Created reservations ['8fa97261-9c30-4e22-9e87-fa7706081aac', '8c430f06-1cf1-43ea-b0b4-710c5cd8f83e', 'ce638db3-b7e8-42db-8456-d46861efa2cc', '39e98212-d0ca-43f5-8853-d45a962fae24'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:33 devstack sudo[107749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3
Jul 31 15:06:33 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:33 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.307s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Deleted volume successfully.
Jul 31 15:06:33 devstack sudo[107752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:33 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-67dbb92e-9ca0-4bcf-a2f8-d0f841112171 tempest-CreateVolumesFromImageTest-312177214 None] Lock "cinder-eb26d85e-d29a-46ff-b147-2f1b1849392e-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-8a1c1c97-b1ce-4edb-97b6-812e6d436a23-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-8a1c1c97-b1ce-4edb-97b6-812e6d436a23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-quobyte-387e87ab-15c2-4b27-a9a8-c662e6a34c34" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-387e87ab-15c2-4b27-a9a8-c662e6a34c34" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-quobyte-8a1c1c97-b1ce-4edb-97b6-812e6d436a23" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-8a1c1c97-b1ce-4edb-97b6-812e6d436a23" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Deleting offline snapshot 8a1c1c97-b1ce-4edb-97b6-812e6d436a23 of volume 387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] snapshot_file for this snap is: volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f10b8ef-a2a8-48ac-8b8d-71349b3fe71d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:33 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:33 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 1G
Jul 31 15:06:33 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:33 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.281s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:33 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Deleted volume successfully.
Jul 31 15:06:33 devstack sudo[107757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23
Jul 31 15:06:33 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d108221a-6823-4b74-bb82-a87ed6ac0616 tempest-VolumeAndVolumeTypeFromImageTest-331722776 None] Lock "cinder-c7b1044b-044f-410a-8ffb-70820cb73bab-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:34 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23" returned: 0 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1e93d3-341d-4b54-8fe6-eb43ec73e7c0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:34 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 1G" returned: 0 in 0.448s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:34 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2
Jul 31 15:06:34 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:34 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34
Jul 31 15:06:34 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:34 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" returned: 0 in 0.379s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:34 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 is being set with open permissions: ugo+rw
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:34 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2
Jul 31 15:06:34 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:34 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34" returned: 0 in 0.671s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:34 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23
Jul 31 15:06:34 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:34 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" returned: 0 in 0.384s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:34 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.info
Jul 31 15:06:34 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:35 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23" returned: 0 in 0.466s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:35 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23
Jul 31 15:06:35 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:35 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.info" returned: 0 in 0.409s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:35 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.info is being set with open permissions: ugo+rw
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:35 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.info
Jul 31 15:06:35 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:35 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34.8a1c1c97-b1ce-4edb-97b6-812e6d436a23" returned: 0 in 0.311s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-8a1c1c97-b1ce-4edb-97b6-812e6d436a23" released by "_delete_snapshot" :: held 1.942s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-387e87ab-15c2-4b27-a9a8-c662e6a34c34" released by "delete_snapshot" :: held 1.976s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:35 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.info" returned: 0 in 0.314s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Created reservations ['22fe0674-d425-4f8b-af04-b6ded255eac7', '8fa79242-6d0a-49ea-b203-6ad7276067ad', '982835e9-6855-49f4-9914-c77e279a79da', '6d8dde75-7853-4c39-987a-c0f75016c4c4'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-351ab694-062a-468e-9c3f-95059c4439a6 tempest-CinderUnicodeTest-1994183188 None] Create snapshot completed successfully
Jul 31 15:06:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Delete snapshot completed successfully.
Jul 31 15:06:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c5189897-4928-4423-8fe9-b7063bee3876 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-8a1c1c97-b1ce-4edb-97b6-812e6d436a23-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "cinder-1f257f0f-0c3c-4618-a6fd-57ddbb5647f2-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-1f257f0f-0c3c-4618-a6fd-57ddbb5647f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "cinder-quobyte-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "cinder-quobyte-1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Deleting offline snapshot 1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 of volume 9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] snapshot_file for this snap is: volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51da8051-3170-4599-b6bf-5e1a07098f6c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:36 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2
Jul 31 15:06:36 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:36 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" returned: 0 in 0.398s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[992c4b71-072d-4e17-bf0e-cfe07fee2c7a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-387e87ab-15c2-4b27-a9a8-c662e6a34c34-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Lock "cinder-387e87ab-15c2-4b27-a9a8-c662e6a34c34-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:36 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3
Jul 31 15:06:36 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-quobyte-387e87ab-15c2-4b27-a9a8-c662e6a34c34" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-387e87ab-15c2-4b27-a9a8-c662e6a34c34" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:36 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a647c5-fb81-413d-b216-ea284810883b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:37 devstack sudo[107805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34
Jul 31 15:06:37 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:37 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" returned: 0 in 0.528s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:37 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2
Jul 31 15:06:37 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:37 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34" returned: 0 in 0.511s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:37 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34
Jul 31 15:06:37 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (76b1bc84-3010-4b68-9e56-f351bcf3554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422a3574-93c0-4eb9-aee0-424d7341bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422a3574-93c0-4eb9-aee0-424d7341bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728797415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52074017-9478-4c6e-9658-c845fff34eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:37Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b96078-c3d5-4175-88cd-8ea4c9293390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b96078-c3d5-4175-88cd-8ea4c9293390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac74847-c805-4929-893a-d5408117b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac74847-c805-4929-893a-d5408117b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52074017-9478-4c6e-9658-c845fff34eb6', 'volume_name': 'volume-52074017-9478-4c6e-9658-c845fff34eb6', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8ca4ec-a81f-4b6c-8b1b-23ceaf8511d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8ca4ec-a81f-4b6c-8b1b-23ceaf8511d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71018d2-2825-4a03-b78c-2b4ec4f70d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:37 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume 52074017-9478-4c6e-9658-c845fff34eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52074017-9478-4c6e-9658-c845fff34eb6', 'volume_size': 1}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728797415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52074017-9478-4c6e-9658-c845fff34eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:37Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Creating volume 52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:37 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:37 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 1073741824
Jul 31 15:06:37 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:37 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" returned: 0 in 0.469s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:37 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2
Jul 31 15:06:37 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:37 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-387e87ab-15c2-4b27-a9a8-c662e6a34c34" returned: 0 in 0.307s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-387e87ab-15c2-4b27-a9a8-c662e6a34c34" released by "delete_volume" :: held 0.885s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Created reservations ['72d819f7-cb32-4495-855f-99b17c8fbf9e', 'd7938d2e-941e-4765-bdd2-7de1aaff75e5', '4f343058-789c-497a-9eb8-de5d08fba7a4', '02b891cd-9b25-46e5-9392-d4a8172b5b37'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:38 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:38 devstack sudo[107831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3.1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" returned: 0 in 0.322s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:38 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-3b747c00-5c7b-40ab-bc9e-e1db6a41f246-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-1f257f0f-0c3c-4618-a6fd-57ddbb5647f2" released by "_delete_snapshot" :: held 1.889s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-3b747c00-5c7b-40ab-bc9e-e1db6a41f246-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" released by "delete_snapshot" :: held 1.937s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "cinder-quobyte-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:38 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 1073741824" returned: 0 in 0.576s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd322ec-c7b2-465a-9bee-5c376fdbbcaf]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:38 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Created reservations ['10d7195f-d0fc-43bf-b4e5-76c7ab7ff774', 'e2abd561-f9cc-42a6-abb7-c5bd26d13382', 'd63c33d1-bf0f-42ae-a38e-399267877def', '6c8b47e2-986b-447a-b3e1-f26986b000cf'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.385s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:38 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6
Jul 31 15:06:38 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Deleted volume successfully.
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a4243a3-895f-4a9e-9189-891dcf43bffa tempest-VolumeDependencyTests-769150457 None] Lock "cinder-387e87ab-15c2-4b27-a9a8-c662e6a34c34-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Delete snapshot completed successfully.
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16aa0cce-42e2-4b2e-8f0b-f39f3c5c3ad6 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-1f257f0f-0c3c-4618-a6fd-57ddbb5647f2-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:38 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246
Jul 31 15:06:38 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:38 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6" returned: 0 in 0.313s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71018d2-2825-4a03-b78c-2b4ec4f70d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52074017-9478-4c6e-9658-c845fff34eb6', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99a1668-68db-4c03-9581-9191182312e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume volume-52074017-9478-4c6e-9658-c845fff34eb6 (52074017-9478-4c6e-9658-c845fff34eb6): created successfully
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99a1668-68db-4c03-9581-9191182312e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (76b1bc84-3010-4b68-9e56-f351bcf3554d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3bad6bc5-1b40-483d-a877-b52bbd082b5c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created volume successfully.
Jul 31 15:06:38 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" returned: 0 in 0.449s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:38 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246
Jul 31 15:06:38 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:39 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" returned: 0 in 0.251s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-quobyte-3b747c00-5c7b-40ab-bc9e-e1db6a41f246" released by "delete_volume" :: held 0.760s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Created reservations ['93dfb37f-66b5-4aab-b789-4564cb7dfe64', '2d5d2371-f0a0-460c-a4c3-4305c11c1a68', 'd11ca423-2dd1-4b1a-9a0b-35c79f90a737', 'da4e234d-fffc-4ae3-b269-2ff5a5302259'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:39 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:39 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:39 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "cinder-9fd70e08-335f-4635-ac60-b0e0a88ab4a3-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Deleted volume successfully.
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-9fd70e08-335f-4635-ac60-b0e0a88ab4a3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (c5df62c3-252d-4aee-86ad-54fee3b54bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edae674a-a77d-4ee0-ba5e-ccef84d21b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-4a5e3e1d-d854-4cd2-8a07-00e4a28c8f47 tempest-VolumeDependencyTests-769150457 None] Lock "cinder-3b747c00-5c7b-40ab-bc9e-e1db6a41f246-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edae674a-a77d-4ee0-ba5e-ccef84d21b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589057915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afd69f8-3cbd-4f53-97ce-139f99bddc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:39Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0e14ac-0eee-417d-892f-85ff2f8a48a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0e14ac-0eee-417d-892f-85ff2f8a48a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1562e9-cb2f-46b2-89fd-1c3ca81bf389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1562e9-cb2f-46b2-89fd-1c3ca81bf389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afd69f8-3cbd-4f53-97ce-139f99bddc6c', 'volume_name': 'volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a83d2ac-eb34-4b67-af3f-0140fd2a84c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a83d2ac-eb34-4b67-af3f-0140fd2a84c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7c79f7-3c52-4fa7-a5ba-0426cc611fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume 6afd69f8-3cbd-4f53-97ce-139f99bddc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c', 'volume_size': 1}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589057915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afd69f8-3cbd-4f53-97ce-139f99bddc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:39Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Creating volume 6afd69f8-3cbd-4f53-97ce-139f99bddc6c {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:39 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "cinder-quobyte-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:39 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c 1073741824
Jul 31 15:06:39 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c2cd7-dfca-4adf-9e38-4d6293e24c53]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:39 devstack sudo[107851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3
Jul 31 15:06:39 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:40 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c 1073741824" returned: 0 in 0.531s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:40 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" returned: 0 in 0.439s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:40 devstack sudo[107860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3
Jul 31 15:06:40 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:40 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c
Jul 31 15:06:40 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:40 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-9fd70e08-335f-4635-ac60-b0e0a88ab4a3" released by "delete_volume" :: held 0.848s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:40 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.656s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Creating offline snapshot 72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 of volume 52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7c79f7-3c52-4fa7-a5ba-0426cc611fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b9aaf-0565-4a8b-add6-bb73f0af8aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7259454-8266-4d6f-bdec-1822d066e473]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c (6afd69f8-3cbd-4f53-97ce-139f99bddc6c): created successfully
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b9aaf-0565-4a8b-add6-bb73f0af8aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (c5df62c3-252d-4aee-86ad-54fee3b54bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fbba3fcc-4a0d-4fa3-a11e-34acbaf938a8 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created volume successfully.
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Created reservations ['d024db00-99b9-4bd6-9f88-207724f6400e', 'e44cf116-c7e0-4352-a9dd-fad7f16dd0b2', '8e00693a-de62-456f-b805-cc8cfc408fd3', '4fd840e5-59df-40c8-84e4-42b4c13ec2cb'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:40 devstack sudo[107866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6
Jul 31 15:06:40 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:40 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:40 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:41 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6" returned: 0 in 0.424s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:41 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 1G
Jul 31 15:06:41 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:41 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.274s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Deleted volume successfully.
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9fcf0f51-0575-4b67-a851-be8f64afdcc1 tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-9fd70e08-335f-4635-ac60-b0e0a88ab4a3-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:41 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 1G" returned: 0 in 0.452s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52074017-9478-4c6e-9658-c845fff34eb6 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:41 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52074017-9478-4c6e-9658-c845fff34eb6 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8
Jul 31 15:06:41 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "cinder-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "cinder-quobyte-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:41 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52074017-9478-4c6e-9658-c845fff34eb6 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:41 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 is being set with open permissions: ugo+rw
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:41 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8
Jul 31 15:06:41 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6a1695-7d42-4ff7-af37-e284206ffbeb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:42 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0
Jul 31 15:06:42 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (79b60543-6e8e-4ff4-8f82-caaa0fabf220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39e0e20-6cbc-467b-8449-341b86a38f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39e0e20-6cbc-467b-8449-341b86a38f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-617537195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146cc9be-5c39-46ae-bd57-538cc88a16ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:42Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3cb650-938f-4936-b772-4cecd3d09b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3cb650-938f-4936-b772-4cecd3d09b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bea265-d310-40d0-be14-a436315bfcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bea265-d310-40d0-be14-a436315bfcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146cc9be-5c39-46ae-bd57-538cc88a16ad', 'volume_name': 'volume-146cc9be-5c39-46ae-bd57-538cc88a16ad', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126df33f-ee10-44ae-9d77-32572e1a5894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126df33f-ee10-44ae-9d77-32572e1a5894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8143f79c-5513-45d9-baf9-be9cd644c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume 146cc9be-5c39-46ae-bd57-538cc88a16ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146cc9be-5c39-46ae-bd57-538cc88a16ad', 'volume_size': 1}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:42 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" returned: 0 in 0.483s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:42 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.info
Jul 31 15:06:42 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:42 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0" returned: 0 in 0.542s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:42 devstack sudo[107895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0
Jul 31 15:06:42 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (5e01c7da-c257-4bdb-8373-9905349eef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75900ca4-a007-4fe0-82d6-d1811c318dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75900ca4-a007-4fe0-82d6-d1811c318dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037866859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2188d0-3403-4f84-aad1-95ce3bdb7c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:43Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ac8e0-9266-4640-8603-67fe4e2569e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ac8e0-9266-4640-8603-67fe4e2569e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75eb885a-df85-42af-82bf-005a96104697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75eb885a-df85-42af-82bf-005a96104697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2188d0-3403-4f84-aad1-95ce3bdb7c27', 'volume_name': 'volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b85c083-df97-416b-bdc5-22ed64ad413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b85c083-df97-416b-bdc5-22ed64ad413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f7c003-4b37-410d-8707-8a97a2cb5254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:42 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume 7e2188d0-3403-4f84-aad1-95ce3bdb7c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27', 'volume_size': 1}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:42 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.info" returned: 0 in 0.427s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:42 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.info is being set with open permissions: ugo+rw
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0" returned: 0 in 0.423s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:42 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.info
Jul 31 15:06:42 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-quobyte-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0" released by "delete_volume" :: held 1.058s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Created reservations ['ec6812c2-bc15-442a-9224-4a47644937cb', '71d6336c-3a0f-42ce-8bc1-d84d207af0f2', '11fddcaa-2512-44ea-adaf-662d61ed01b8', '6131ae6b-8181-4f9e-9286-7c463b352af6'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:43 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:43 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:43 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.info" returned: 0 in 0.334s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-617537195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146cc9be-5c39-46ae-bd57-538cc88a16ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:42Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Creating volume 146cc9be-5c39-46ae-bd57-538cc88a16ad {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:43 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:43 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad 1073741824
Jul 31 15:06:43 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-832fa5c1-8b79-4e7c-bbc9-bb1d0c6c4e3c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Create snapshot completed successfully
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (733e5fa8-6e8b-49da-8011-28a1ab8674ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335aa946-a5b5-4c98-8f0f-7e9063a94082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335aa946-a5b5-4c98-8f0f-7e9063a94082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836875635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b708d55f-40be-4f1e-969d-ee58ecad7498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:43Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03875b7c-d167-4046-9e92-2a0a7af6aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03875b7c-d167-4046-9e92-2a0a7af6aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2ef8ae-7562-4283-9a62-b8d3a9b1739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2ef8ae-7562-4283-9a62-b8d3a9b1739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b708d55f-40be-4f1e-969d-ee58ecad7498', 'volume_name': 'volume-b708d55f-40be-4f1e-969d-ee58ecad7498', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5c3bcb-8452-4db1-b328-613c86a2ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5c3bcb-8452-4db1-b328-613c86a2ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23d2e80-5424-4c8f-b556-2d2ce52f534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume b708d55f-40be-4f1e-969d-ee58ecad7498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b708d55f-40be-4f1e-969d-ee58ecad7498', 'volume_size': 1}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:43 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.359s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Deleted volume successfully.
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d3aef86c-8649-4855-9426-97cf6a6b148c tempest-CinderUnicodeTest-1994183188 None] Lock "cinder-a02faa8a-1dbf-4574-9e27-b0e80d7fdec0-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (b659da78-bfc2-40e4-8f20-a5922dec2e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:43 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63a43fa-e6d7-43e7-bc16-9137c5cb25b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad 1073741824" returned: 0 in 0.635s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63a43fa-e6d7-43e7-bc16-9137c5cb25b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622461594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618fb53b-c73f-48f1-bc5a-ea90976681ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:44Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0a352d-028e-4630-bc82-f43de4dbd223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0a352d-028e-4630-bc82-f43de4dbd223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63210dfa-cdf0-4dec-8bba-caf49e3fb257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63210dfa-cdf0-4dec-8bba-caf49e3fb257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618fb53b-c73f-48f1-bc5a-ea90976681ff', 'volume_name': 'volume-618fb53b-c73f-48f1-bc5a-ea90976681ff', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3f223-3c21-4ad8-8d74-7f22dc55e6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3f223-3c21-4ad8-8d74-7f22dc55e6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbe1300-3437-4ed1-bee4-78846bfdbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:43 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume 618fb53b-c73f-48f1-bc5a-ea90976681ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618fb53b-c73f-48f1-bc5a-ea90976681ff', 'volume_size': 1}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:44 devstack sudo[107912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad
Jul 31 15:06:44 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (efa40155-62b2-4c62-9cf0-d56b58a2472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e830f-ac75-4433-999a-41ae9d043493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e830f-ac75-4433-999a-41ae9d043493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-566715801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6637f-5bfc-4f7d-b7da-35b6655fbde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:44Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a5d530-151e-4aed-9a2e-e0bb33a61073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a5d530-151e-4aed-9a2e-e0bb33a61073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a066961b-6835-482f-9d86-244d333c62d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a066961b-6835-482f-9d86-244d333c62d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d6637f-5bfc-4f7d-b7da-35b6655fbde5', 'volume_name': 'volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8759a-7ae3-4b23-9506-cfa6fde7125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8759a-7ae3-4b23-9506-cfa6fde7125b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac555238-8c0b-434a-ae7f-775a478d6bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:44 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume d9d6637f-5bfc-4f7d-b7da-35b6655fbde5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5', 'volume_size': 1}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:44 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad" returned: 0 in 0.334s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037866859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2188d0-3403-4f84-aad1-95ce3bdb7c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:43Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Creating volume 7e2188d0-3403-4f84-aad1-95ce3bdb7c27 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:44 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8143f79c-5513-45d9-baf9-be9cd644c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146cc9be-5c39-46ae-bd57-538cc88a16ad', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2e1c33-de49-4a5f-88b9-f0d8afe7d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:44 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27 1073741824
Jul 31 15:06:44 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:44 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume volume-146cc9be-5c39-46ae-bd57-538cc88a16ad (146cc9be-5c39-46ae-bd57-538cc88a16ad): created successfully
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2e1c33-de49-4a5f-88b9-f0d8afe7d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (79b60543-6e8e-4ff4-8f82-caaa0fabf220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:44 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-452a2b51-17cc-435d-a185-0a8a93e0790b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created volume successfully.
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:44 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (44b78f9f-dc4b-4c39-8bb1-e87672063a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e302ac-0315-41e4-a3f4-4102ef7c21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e302ac-0315-41e4-a3f4-4102ef7c21e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929033890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83636efe-135f-491f-b94d-ba727236161a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:45Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7788ad0-908b-412c-b5dc-f9e9c8b66788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7788ad0-908b-412c-b5dc-f9e9c8b66788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cead95a-4665-45f3-b83a-921075b591dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cead95a-4665-45f3-b83a-921075b591dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83636efe-135f-491f-b94d-ba727236161a', 'volume_name': 'volume-83636efe-135f-491f-b94d-ba727236161a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a91878f-3ba8-4a61-9c36-cef14c9c0776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a91878f-3ba8-4a61-9c36-cef14c9c0776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f856a5e4-da70-46c9-a36a-25bcb45a3fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume 83636efe-135f-491f-b94d-ba727236161a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83636efe-135f-491f-b94d-ba727236161a', 'volume_size': 1}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:45 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27 1073741824" returned: 0 in 0.728s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:45 devstack sudo[107921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27
Jul 31 15:06:45 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (9e6dc2da-98fe-4753-a02c-549851577f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f85e032-12d2-4fbb-829a-02531e513fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f85e032-12d2-4fbb-829a-02531e513fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-72740469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76a7a68-a4a8-48c1-8b09-40c4acbf3993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:45Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682a9bfb-feea-4c29-87e8-202287f32e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682a9bfb-feea-4c29-87e8-202287f32e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45331331-a0d5-4bb2-96ae-8a81f9dcd999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45331331-a0d5-4bb2-96ae-8a81f9dcd999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e76a7a68-a4a8-48c1-8b09-40c4acbf3993', 'volume_name': 'volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fbbab7-1a38-4002-9cdb-a0649b89b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fbbab7-1a38-4002-9cdb-a0649b89b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de62abe-3f92-46d5-834d-0fcfa9186f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume e76a7a68-a4a8-48c1-8b09-40c4acbf3993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993', 'volume_size': 1}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27" returned: 0 in 0.435s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.107s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836875635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b708d55f-40be-4f1e-969d-ee58ecad7498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:43Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Creating volume b708d55f-40be-4f1e-969d-ee58ecad7498 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:45 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f7c003-4b37-410d-8707-8a97a2cb5254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498 1073741824
Jul 31 15:06:45 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca39e01-881b-48c2-b900-51a30efff0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:45 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27 (7e2188d0-3403-4f84-aad1-95ce3bdb7c27): created successfully
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca39e01-881b-48c2-b900-51a30efff0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:45 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (5e01c7da-c257-4bdb-8373-9905349eef94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2add34a4-b27f-4ed3-997f-7471d1bab5d4 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created volume successfully.
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (a1b74939-bc94-41d8-9a15-171ad03277fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb8a6ef-dc70-4780-90ec-f9df6b588f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb8a6ef-dc70-4780-90ec-f9df6b588f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1135160614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cc1cee-d559-4aa0-b527-3bc52c1af585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:46Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715b4e6-195f-47f4-958d-3c71f3d18d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715b4e6-195f-47f4-958d-3c71f3d18d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90970b3b-edf3-4320-8b79-82c545f56dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90970b3b-edf3-4320-8b79-82c545f56dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cc1cee-d559-4aa0-b527-3bc52c1af585', 'volume_name': 'volume-46cc1cee-d559-4aa0-b527-3bc52c1af585', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d60f17-ea87-4997-b0e0-6f6d29cd8506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d60f17-ea87-4997-b0e0-6f6d29cd8506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69741a66-d4f2-4882-9a90-be3017efa9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume 46cc1cee-d559-4aa0-b527-3bc52c1af585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cc1cee-d559-4aa0-b527-3bc52c1af585', 'volume_size': 1}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:46 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498 1073741824" returned: 0 in 0.591s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:46 devstack sudo[107931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498
Jul 31 15:06:46 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (d5bbb86b-de5b-4f4d-b4a0-808439124a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc66c2ed-0719-469a-9936-ed9cc4cbaefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc66c2ed-0719-469a-9936-ed9cc4cbaefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561960829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1dc8bc-4bc3-41d5-8929-75cb44476f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:46Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba2a5a4-a1cf-46f6-911e-b171363bfd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba2a5a4-a1cf-46f6-911e-b171363bfd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05922a95-7183-4fa5-b718-b6fa24981ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05922a95-7183-4fa5-b718-b6fa24981ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1dc8bc-4bc3-41d5-8929-75cb44476f4a', 'volume_name': 'volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a6d489-72a2-41b8-8f3e-e5b55567cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a6d489-72a2-41b8-8f3e-e5b55567cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a00e8-3419-47e1-a0a7-ee55edd31975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume ae1dc8bc-4bc3-41d5-8929-75cb44476f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a', 'volume_size': 1}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498" returned: 0 in 0.362s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.614s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622461594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618fb53b-c73f-48f1-bc5a-ea90976681ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:44Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Creating volume 618fb53b-c73f-48f1-bc5a-ea90976681ff {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:46 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23d2e80-5424-4c8f-b556-2d2ce52f534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b708d55f-40be-4f1e-969d-ee58ecad7498', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e8e6e3-ede7-480e-8f1f-ebff34e92dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:46 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff 1073741824
Jul 31 15:06:46 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:46 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume volume-b708d55f-40be-4f1e-969d-ee58ecad7498 (b708d55f-40be-4f1e-969d-ee58ecad7498): created successfully
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e8e6e3-ede7-480e-8f1f-ebff34e92dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:46 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (733e5fa8-6e8b-49da-8011-28a1ab8674ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:46 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fdf954e9-332c-4a56-b103-562a12226765 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created volume successfully.
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (f7321205-dc36-4402-8392-f8905a82bcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3243997d-a0d8-436e-9e0d-91e539613e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3243997d-a0d8-436e-9e0d-91e539613e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028849183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14e18c2-7320-4478-929b-d9f1492b6700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:47Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428023a8-6d66-4b6c-b1f3-8e63b8fd473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428023a8-6d66-4b6c-b1f3-8e63b8fd473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba2a0ef-82e7-434e-958b-305c541626cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba2a0ef-82e7-434e-958b-305c541626cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd14e18c2-7320-4478-929b-d9f1492b6700', 'volume_name': 'volume-d14e18c2-7320-4478-929b-d9f1492b6700', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dba45eb-b7f8-42e8-9cc2-1ad4942cfa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dba45eb-b7f8-42e8-9cc2-1ad4942cfa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d98eb6-6019-4de9-8254-e94a0d17e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:47 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume d14e18c2-7320-4478-929b-d9f1492b6700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d14e18c2-7320-4478-929b-d9f1492b6700', 'volume_size': 1}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:47 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff 1073741824" returned: 0 in 0.613s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:47 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff
Jul 31 15:06:47 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:47 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.224s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-566715801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6637f-5bfc-4f7d-b7da-35b6655fbde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1a94ae17f46bf9a37a5b877d3065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:44Z,use_quota=True,user_id='b5a93838abf0468d841417b7ab1ebf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Creating volume d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:47 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:47 devstack sudo[107943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 1073741824
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbe1300-3437-4ed1-bee4-78846bfdbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618fb53b-c73f-48f1-bc5a-ea90976681ff', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:47 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0233b5b0-7bb1-4042-b3e9-d72ff08a16a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:47 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume volume-618fb53b-c73f-48f1-bc5a-ea90976681ff (618fb53b-c73f-48f1-bc5a-ea90976681ff): created successfully
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0233b5b0-7bb1-4042-b3e9-d72ff08a16a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:47 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (b659da78-bfc2-40e4-8f20-a5922dec2e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0bd9e935-29f6-4aa2-b56a-d05bfa507200 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created volume successfully.
Jul 31 15:06:48 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 1073741824" returned: 0 in 0.576s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:48 devstack sudo[107950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5
Jul 31 15:06:48 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:48 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.301s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929033890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83636efe-135f-491f-b94d-ba727236161a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:45Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Creating volume 83636efe-135f-491f-b94d-ba727236161a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:48 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d3a08c04-68a0-4685-91ec-b4cab691f73a tempest-ProjectAdminTests-884453447 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6902122497559, 'free_capacity_gb': 1775.6902122497559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 31 15:06:48 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a 1073741824
Jul 31 15:06:48 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac555238-8c0b-434a-ae7f-775a478d6bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c29af0-92ec-4ed9-866f-41ca41e5c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Volume volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 (d9d6637f-5bfc-4f7d-b7da-35b6655fbde5): created successfully
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c29af0-92ec-4ed9-866f-41ca41e5c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Flow 'volume_create_manager' (efa40155-62b2-4c62-9cf0-d56b58a2472a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:48 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-61548895-eecb-46e4-a060-4f44d8e746d7 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created volume successfully.
Jul 31 15:06:48 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a 1073741824" returned: 0 in 0.475s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:48 devstack sudo[107961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a
Jul 31 15:06:48 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-quobyte-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:49 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a" returned: 0 in 0.412s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.763s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-72740469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76a7a68-a4a8-48c1-8b09-40c4acbf3993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:45Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Creating volume e76a7a68-a4a8-48c1-8b09-40c4acbf3993 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:49 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5" acquired by "delete_volume" :: waited 0.053s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:49 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993 1073741824
Jul 31 15:06:49 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f856a5e4-da70-46c9-a36a-25bcb45a3fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83636efe-135f-491f-b94d-ba727236161a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a18e854-16c1-4b58-86a1-56aed2f53508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[882cb8ca-f56b-4a9c-9c18-46163c06d028]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:49 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume volume-83636efe-135f-491f-b94d-ba727236161a (83636efe-135f-491f-b94d-ba727236161a): created successfully
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a18e854-16c1-4b58-86a1-56aed2f53508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (44b78f9f-dc4b-4c39-8bb1-e87672063a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-46c005c5-bd1c-4387-bbeb-c06b600c4710 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created volume successfully.
Jul 31 15:06:49 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5
Jul 31 15:06:49 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:49 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993 1073741824" returned: 0 in 0.560s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:49 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5" returned: 0 in 0.535s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:49 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5
Jul 31 15:06:49 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:49 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993
Jul 31 15:06:49 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:50 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5" returned: 0 in 0.372s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5" released by "delete_volume" :: held 0.973s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:50 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993" returned: 0 in 0.450s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.303s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1135160614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cc1cee-d559-4aa0-b527-3bc52c1af585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:46Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Creating volume 46cc1cee-d559-4aa0-b527-3bc52c1af585 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:50 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de62abe-3f92-46d5-834d-0fcfa9186f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:50 devstack sudo[107981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585 1073741824
Jul 31 15:06:50 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64ad1fc-dbd3-4695-9ed9-54fa3216d88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created reservations ['60438015-8554-4b67-8dbb-cda95c9e3dfb', '8be451ac-bb60-44e9-a8ad-b68b7401facb', '6a2a0475-09af-47ec-ab13-137c3b1dfe0d', 'f8488d65-658c-44ef-9566-c5d059770868'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:50 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993 (e76a7a68-a4a8-48c1-8b09-40c4acbf3993): created successfully
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64ad1fc-dbd3-4695-9ed9-54fa3216d88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (9e6dc2da-98fe-4753-a02c-549851577f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a94a2570-5232-476e-9ec3-a30e1488d26a tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created volume successfully.
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:50 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:50 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:50 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.301s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Deleted volume successfully.
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3f22c059-2e60-4fc9-8795-fb17d429c48b tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-d9d6637f-5bfc-4f7d-b7da-35b6655fbde5-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:50 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585 1073741824" returned: 0 in 0.568s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:51 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585
Jul 31 15:06:51 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:51 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585" returned: 0 in 0.276s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.740s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561960829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1dc8bc-4bc3-41d5-8929-75cb44476f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:46Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Creating volume ae1dc8bc-4bc3-41d5-8929-75cb44476f4a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:51 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69741a66-d4f2-4882-9a90-be3017efa9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cc1cee-d559-4aa0-b527-3bc52c1af585', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8794306-ae0a-4a91-823a-30613ffce693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:51 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a 1073741824
Jul 31 15:06:51 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume volume-46cc1cee-d559-4aa0-b527-3bc52c1af585 (46cc1cee-d559-4aa0-b527-3bc52c1af585): created successfully
Jul 31 15:06:51 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8794306-ae0a-4a91-823a-30613ffce693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (a1b74939-bc94-41d8-9a15-171ad03277fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:51 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fb73c971-3e15-46d1-bf17-5c1cfb3af0d7 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created volume successfully.
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-618fb53b-c73f-48f1-bc5a-ea90976681ff-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-618fb53b-c73f-48f1-bc5a-ea90976681ff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-quobyte-618fb53b-c73f-48f1-bc5a-ea90976681ff" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-618fb53b-c73f-48f1-bc5a-ea90976681ff" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a121c88-b3ce-4a46-8443-b4f6cfc63641]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:51 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff
Jul 31 15:06:51 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:51 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a 1073741824" returned: 0 in 0.585s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:51 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a
Jul 31 15:06:51 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:52 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff" returned: 0 in 0.426s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:52 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff
Jul 31 15:06:52 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:52 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a" returned: 0 in 0.327s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.119s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028849183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14e18c2-7320-4478-929b-d9f1492b6700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c3595207cd462f9b8b8f39ab9fc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:06:47Z,use_quota=True,user_id='aea8c4d6317a4472953c0ebe5993fc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Creating volume d14e18c2-7320-4478-929b-d9f1492b6700 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:06:52 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a00e8-3419-47e1-a0a7-ee55edd31975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce9495f-204e-49c2-be17-68b56dcbc6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:52 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700 1073741824
Jul 31 15:06:52 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:52 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a (ae1dc8bc-4bc3-41d5-8929-75cb44476f4a): created successfully
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce9495f-204e-49c2-be17-68b56dcbc6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (d5bbb86b-de5b-4f4d-b4a0-808439124a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:52 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-62bc1e0e-1e1a-4989-99f0-3334b374157f tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created volume successfully.
Jul 31 15:06:52 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-618fb53b-c73f-48f1-bc5a-ea90976681ff" returned: 0 in 0.366s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-618fb53b-c73f-48f1-bc5a-ea90976681ff" released by "delete_volume" :: held 0.844s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created reservations ['a56523ec-09cc-4cd2-a33d-d73195a759d1', 'd205b6a8-f143-4952-bc94-219369910077', 'c1b2af7d-2a90-4b80-9b59-5ff2d1c57abb', 'eb43d325-5225-4c28-814c-f41c6dab0fda'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:52 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:52 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-b708d55f-40be-4f1e-969d-ee58ecad7498-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-b708d55f-40be-4f1e-969d-ee58ecad7498-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:52 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700 1073741824" returned: 0 in 0.638s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-quobyte-b708d55f-40be-4f1e-969d-ee58ecad7498" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-b708d55f-40be-4f1e-969d-ee58ecad7498" acquired by "delete_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:53 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700
Jul 31 15:06:53 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44af6684-8cc5-4eaa-9a59-a0f54936a7e8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:53 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Deleted volume successfully.
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6569fd49-8125-4735-8b27-48cd4c7a3a46 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-618fb53b-c73f-48f1-bc5a-ea90976681ff-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:53 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498
Jul 31 15:06:53 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:53 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700" returned: 0 in 0.379s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d98eb6-6019-4de9-8254-e94a0d17e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d14e18c2-7320-4478-929b-d9f1492b6700', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed10c9ad-946d-4b5e-b8aa-28de8bf08355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:06:53 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Volume volume-d14e18c2-7320-4478-929b-d9f1492b6700 (d14e18c2-7320-4478-929b-d9f1492b6700): created successfully
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed10c9ad-946d-4b5e-b8aa-28de8bf08355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Flow 'volume_create_manager' (f7321205-dc36-4402-8392-f8905a82bcf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:06:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-fc924f64-d8d9-4db4-9ebd-a887a38ff6d1 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created volume successfully.
Jul 31 15:06:53 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498" returned: 0 in 0.434s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:53 devstack sudo[108029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498
Jul 31 15:06:53 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:53 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-b708d55f-40be-4f1e-969d-ee58ecad7498" returned: 0 in 0.296s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-b708d55f-40be-4f1e-969d-ee58ecad7498" released by "delete_volume" :: held 0.794s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created reservations ['b7ca0649-bed7-4b22-88b3-5c10a19480b8', '81797d57-0e38-458d-914b-ae6d396b2058', '4154244f-6726-46f8-976c-a3a99bcb01cc', 'a7ac67a5-72d6-4072-90b3-abb249ff8e1b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:54 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:54 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-7e2188d0-3403-4f84-aad1-95ce3bdb7c27-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-7e2188d0-3403-4f84-aad1-95ce3bdb7c27-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-d14e18c2-7320-4478-929b-d9f1492b6700-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-d14e18c2-7320-4478-929b-d9f1492b6700-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-quobyte-7e2188d0-3403-4f84-aad1-95ce3bdb7c27" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-d14e18c2-7320-4478-929b-d9f1492b6700" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-7e2188d0-3403-4f84-aad1-95ce3bdb7c27" acquired by "delete_volume" :: waited 0.038s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-d14e18c2-7320-4478-929b-d9f1492b6700" acquired by "delete_volume" :: waited 0.053s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[872c24a1-09c3-4c40-bc78-2fd045886d84]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:54 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f73e948-e081-4a19-810c-72f73beac3ef]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:54 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Deleted volume successfully.
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e1edc691-69fe-49c2-9568-9cd0a4bb8270 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-b708d55f-40be-4f1e-969d-ee58ecad7498-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:54 devstack sudo[108035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27
Jul 31 15:06:54 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:54 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700
Jul 31 15:06:54 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:54 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700" returned: 0 in 0.466s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:54 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27" returned: 0 in 0.518s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:54 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700
Jul 31 15:06:54 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:54 devstack sudo[108047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27
Jul 31 15:06:54 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:55 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-d14e18c2-7320-4478-929b-d9f1492b6700" returned: 0 in 0.316s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-d14e18c2-7320-4478-929b-d9f1492b6700" released by "delete_volume" :: held 0.856s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:55 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-7e2188d0-3403-4f84-aad1-95ce3bdb7c27" returned: 0 in 0.332s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-7e2188d0-3403-4f84-aad1-95ce3bdb7c27" released by "delete_volume" :: held 0.934s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created reservations ['d94a6b1b-9b67-40b3-8d9d-5bec0e76727c', 'e15941ae-6678-4be6-88ea-8221ff90a35d', '8cb46a0a-c43f-4ea8-a6c0-25ef827262ce', '258c7704-beb7-44da-96d5-b90656d6ea2b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created reservations ['41819d4e-9a38-4a58-97a0-d2b90730b76f', '63c265ae-f367-40d8-a031-50e6e9a4c05a', 'd6273b81-010a-4596-a8ae-ec0a2f67d7a1', '2aa19331-b4f2-47b6-93a8-aa32e0cea720'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:55 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:55 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:55 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:55 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[151f5ee9-ed8a-4d0b-8158-3e7c358cf7bf]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:55 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a
Jul 31 15:06:55 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:55 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.468s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:55 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Deleted volume successfully.
Jul 31 15:06:55 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9e9f0bd5-b63f-49ed-bb85-4d6dcf060374 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-d14e18c2-7320-4478-929b-d9f1492b6700-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.414s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:55 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:55 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Deleted volume successfully.
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-517c900e-0faa-4ddd-bcae-d5baf14e567c tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-7e2188d0-3403-4f84-aad1-95ce3bdb7c27-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:56 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a" returned: 0 in 0.452s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:56 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a
Jul 31 15:06:56 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:56 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a" returned: 0 in 0.277s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a" released by "delete_volume" :: held 0.797s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-146cc9be-5c39-46ae-bd57-538cc88a16ad-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-146cc9be-5c39-46ae-bd57-538cc88a16ad-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-quobyte-146cc9be-5c39-46ae-bd57-538cc88a16ad" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created reservations ['f712429b-abd5-4804-a86f-2083151c4a3f', '05bdb5c5-d9bd-4969-b427-e3789ce9def8', '429706cd-f0f5-49a9-a570-ca7cff69a45f', '43af133b-8654-4a8b-900c-37e59fd7cac1'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-146cc9be-5c39-46ae-bd57-538cc88a16ad" acquired by "delete_volume" :: waited 0.056s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d85e4-a786-44f2-9294-e3231d4dc0a0]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:56 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:56 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:56 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad
Jul 31 15:06:56 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:57 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.289s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Deleted volume successfully.
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-666a9d68-65fe-42b0-a403-f94d82272534 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-ae1dc8bc-4bc3-41d5-8929-75cb44476f4a-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:57 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad" returned: 0 in 0.502s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:57 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad
Jul 31 15:06:57 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:57 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-146cc9be-5c39-46ae-bd57-538cc88a16ad" returned: 0 in 0.261s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-146cc9be-5c39-46ae-bd57-538cc88a16ad" released by "delete_volume" :: held 0.837s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created reservations ['cf913c49-c140-465c-b75e-d832c8bfee38', 'a81d6316-f3d7-4a46-9fbc-9a4e66da1189', '2f1dc47b-1fb2-427c-aafa-d523bfba5853', '469c3ac1-2c8e-413f-ba02-c625fb003c10'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:57 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:57 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-46cc1cee-d559-4aa0-b527-3bc52c1af585-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-46cc1cee-d559-4aa0-b527-3bc52c1af585-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-46cc1cee-d559-4aa0-b527-3bc52c1af585" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-46cc1cee-d559-4aa0-b527-3bc52c1af585" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f78dd9-f682-4f2c-afda-fe3162d927bf]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:58 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:58 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:58 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.317s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:58 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Deleted volume successfully.
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-51d6aa7d-0294-4d95-8ba3-76039d5c927a tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-146cc9be-5c39-46ae-bd57-538cc88a16ad-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:58 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585
Jul 31 15:06:58 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:58 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.287s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:06:58 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585" returned: 0 in 0.405s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:58 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585
Jul 31 15:06:58 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:58 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-46cc1cee-d559-4aa0-b527-3bc52c1af585" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-46cc1cee-d559-4aa0-b527-3bc52c1af585" released by "delete_volume" :: held 0.706s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created reservations ['bee5f0b9-a8b7-4567-b3b3-9da61488bc84', 'c9b960da-1d7c-4d01-b405-67392310d2c0', 'd9fe5eb5-7375-4272-a4fc-255b05af89ea', '6ce5bd74-c2aa-48b2-bfb9-6f57f53ffcd6'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-6afd69f8-3cbd-4f53-97ce-139f99bddc6c-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-6afd69f8-3cbd-4f53-97ce-139f99bddc6c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:58 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:58 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "cinder-quobyte-6afd69f8-3cbd-4f53-97ce-139f99bddc6c" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-6afd69f8-3cbd-4f53-97ce-139f99bddc6c" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f72273-7cf6-4aa0-9270-3722dfad4ac2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-e76a7a68-a4a8-48c1-8b09-40c4acbf3993-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-e76a7a68-a4a8-48c1-8b09-40c4acbf3993-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:59 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c
Jul 31 15:06:59 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:59 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.319s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:06:59 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Deleted volume successfully.
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-e76a7a68-a4a8-48c1-8b09-40c4acbf3993" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9f15aed0-0936-44e6-bdd8-4c136e73b357 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-46cc1cee-d559-4aa0-b527-3bc52c1af585-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-e76a7a68-a4a8-48c1-8b09-40c4acbf3993" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad76425-460b-4699-8645-104f247a8ef8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:59 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993
Jul 31 15:06:59 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:59 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c" returned: 0 in 0.494s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:59 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c
Jul 31 15:06:59 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:59 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993" returned: 0 in 0.389s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:59 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993
Jul 31 15:06:59 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:59 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6afd69f8-3cbd-4f53-97ce-139f99bddc6c" returned: 0 in 0.264s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-quobyte-6afd69f8-3cbd-4f53-97ce-139f99bddc6c" released by "delete_volume" :: held 0.802s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Created reservations ['16e9f4dd-75eb-4bcc-bb48-11ca3f343a5d', '17fe52b2-283d-4c9a-acb3-681283d62623', 'b62c8a7b-d9c6-4b3d-b6fa-ac5921cf5a72', 'a70656ff-0705-4abf-8f0b-c1a2a2ea8ad2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:06:59 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-e76a7a68-a4a8-48c1-8b09-40c4acbf3993" returned: 0 in 0.270s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:06:59 devstack sudo[108109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:06:59 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-e76a7a68-a4a8-48c1-8b09-40c4acbf3993" released by "delete_volume" :: held 0.703s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:06:59 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created reservations ['3ffdcfb4-d2c8-4cb2-aec4-9276b91c5fd5', '0b475deb-56a3-4211-8cde-faaba0c973d8', '1e6508c5-ed1c-40d0-97d7-f93a4bd5c49a', 'c5bb7a16-a71a-48cb-aaa3-5a71335b92be'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:00 devstack sudo[108111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:00 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:00 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.327s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Deleted volume successfully.
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e9439587-ca79-4223-9953-47e4b46ce2a5 tempest-CreateVolumesFromSourceVolumeTest-543849271 None] Lock "cinder-6afd69f8-3cbd-4f53-97ce-139f99bddc6c-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-83636efe-135f-491f-b94d-ba727236161a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-83636efe-135f-491f-b94d-ba727236161a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-83636efe-135f-491f-b94d-ba727236161a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-83636efe-135f-491f-b94d-ba727236161a" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[16535a57-9c2e-47ab-8b81-dba776b4c1cd]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:00 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.403s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:00 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Deleted volume successfully.
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e0778ea1-79b6-448f-82e7-980d6c2698ef tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-e76a7a68-a4a8-48c1-8b09-40c4acbf3993-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:00 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a
Jul 31 15:07:00 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:00 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a" returned: 0 in 0.387s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:00 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a
Jul 31 15:07:00 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:01 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-83636efe-135f-491f-b94d-ba727236161a" returned: 0 in 0.299s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-83636efe-135f-491f-b94d-ba727236161a" released by "delete_volume" :: held 0.744s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created reservations ['ea0176b5-a861-4790-b86c-1171122bdd43', 'b918338e-169e-4e55-94d9-5f0b5175bfaf', '4a2546d2-7ca0-4572-b85c-5619897b6ba7', '84bbcca8-e9fb-4bad-9d16-5ec05519e77f'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:01 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:01 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-72809d22-e0d4-4cf8-bd3a-06bdb42e48a8-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-72809d22-e0d4-4cf8-bd3a-06bdb42e48a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-52074017-9478-4c6e-9658-c845fff34eb6" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-52074017-9478-4c6e-9658-c845fff34eb6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:01 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.384s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Deleting offline snapshot 72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 of volume 52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] snapshot_file for this snap is: volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:01 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Deleted volume successfully.
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aba676d-64a7-400e-a288-a6a4964fb6de]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-a4475661-6943-4d0d-bef9-5e4236b8ac46 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-83636efe-135f-491f-b94d-ba727236161a-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:01 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8
Jul 31 15:07:01 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:02 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" returned: 0 in 0.414s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:02 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52074017-9478-4c6e-9658-c845fff34eb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:02 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ab1cd-af7b-4741-85a8-ba413304f33a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:02 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6
Jul 31 15:07:02 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:02 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6" returned: 0 in 0.425s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:02 devstack sudo[108142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8
Jul 31 15:07:02 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:02 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" returned: 0 in 0.407s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:03 devstack sudo[108148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8
Jul 31 15:07:03 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:03 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6.72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" returned: 0 in 0.271s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-72809d22-e0d4-4cf8-bd3a-06bdb42e48a8" released by "_delete_snapshot" :: held 1.656s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-52074017-9478-4c6e-9658-c845fff34eb6" released by "delete_snapshot" :: held 1.701s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created reservations ['b5a7eb21-09f0-42eb-90c9-a57685651306', 'c5b6aeed-8fb7-447c-9d34-3d5551ad8cee', '954eca25-e774-4523-bcf1-2ac49d935a26', '6025c133-ec4a-4cbb-ac07-bec7b165f3e6'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:03 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Delete snapshot completed successfully.
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f64160f5-7f50-471a-90e4-571b2acefb10 tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-72809d22-e0d4-4cf8-bd3a-06bdb42e48a8-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-52074017-9478-4c6e-9658-c845fff34eb6-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-52074017-9478-4c6e-9658-c845fff34eb6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "cinder-quobyte-52074017-9478-4c6e-9658-c845fff34eb6" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-52074017-9478-4c6e-9658-c845fff34eb6" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[72884492-3b97-40b0-93c5-7695e61fef39]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:04 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6
Jul 31 15:07:04 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:04 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6" returned: 0 in 0.410s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:04 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6
Jul 31 15:07:04 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:04 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-52074017-9478-4c6e-9658-c845fff34eb6" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-quobyte-52074017-9478-4c6e-9658-c845fff34eb6" released by "delete_volume" :: held 0.728s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Created reservations ['62ac0513-adc1-4429-a302-d4245c5e2316', '97e55060-ec12-4b7c-96f7-9a62901824df', '2156b95c-fbed-4893-9afc-6b9726ad7291', '36f29d64-6d03-468e-a99c-07a53c7e3eef'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:04 devstack sudo[108159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:04 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:04 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:04 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Deleted volume successfully.
Jul 31 15:07:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d0cfe6f8-48f4-4ebf-bb39-6e799072be7c tempest-CreateVolumesFromSnapshotTest-1957027991 None] Lock "cinder-52074017-9478-4c6e-9658-c845fff34eb6-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Flow 'volume_create_manager' (d663baf3-0c1f-4e87-9ae8-037517700b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e87ff1-bd66-444c-888a-f81a5c046ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e87ff1-bd66-444c-888a-f81a5c046ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852b3702-6d39-42e1-a71a-c3a4ea7e81b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d314fadc0884ddba6a8821ea90a5080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:07Z,use_quota=True,user_id='cce85b9ae51b41ce9761d6f0451abbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a6e7bf-7614-434e-a4a1-02bd76c48acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a6e7bf-7614-434e-a4a1-02bd76c48acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abd50a4-7688-4318-ab9b-1567063e6a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:06 devstack cinder-volume[88594]: DEBUG cinder.image.glance [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Creating Keystone auth plugin from conf {{(pid=88594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abd50a4-7688-4318-ab9b-1567063e6a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '852b3702-6d39-42e1-a71a-c3a4ea7e81b6', 'volume_name': 'volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6', 'volume_size': 1, 'image_id': 'e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '149537bd352651c50225d58734645832', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d314fadc0884ddba6a8821ea90a5080', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c456da1c80530f2e9eebcf45f548cd5f9ed5b48f8b426f5ae0d3a0df870eaf331faa5b7aa1a9d72d85848493126715cee2a2c25832aa792cbde571fed0526db', 'id': 'e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'created_at': datetime.datetime(2026, 7, 31, 13, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda232ba0>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1704bd-c787-4003-858b-d05b97ca9336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1704bd-c787-4003-858b-d05b97ca9336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4386b30a-f380-4f24-8659-8bc88f40bf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:07 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Volume 852b3702-6d39-42e1-a71a-c3a4ea7e81b6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6', 'volume_size': 1, 'image_id': 'e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '149537bd352651c50225d58734645832', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d314fadc0884ddba6a8821ea90a5080', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c456da1c80530f2e9eebcf45f548cd5f9ed5b48f8b426f5ae0d3a0df870eaf331faa5b7aa1a9d72d85848493126715cee2a2c25832aa792cbde571fed0526db', 'id': 'e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'created_at': datetime.datetime(2026, 7, 31, 13, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda232ba0>}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Trying to clone 852b3702-6d39-42e1-a71a-c3a4ea7e81b6 from image e4964958-abb3-4d77-9fc0-35e3da4a86b0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'metadata': {}}]). {{(pid=88594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 31 15:07:07 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Image download 0.00 MB at 0.00 MB/s
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1d472-d91f-4c99-bab4-994ba5e15484]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:07 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD
Jul 31 15:07:07 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:07 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:07 devstack sudo[108166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD
Jul 31 15:07:07 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:07 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:07:07 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Temporary image e4964958-abb3-4d77-9fc0-35e3da4a86b0 is fetched for user cce85b9ae51b41ce9761d6f0451abbae. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b8e78-7eb2-4318-b3b8-91ea630f0ecd]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:08 devstack sudo[108171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD
Jul 31 15:07:08 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:08 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:08 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD
Jul 31 15:07:08 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:08 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852b3702-6d39-42e1-a71a-c3a4ea7e81b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d314fadc0884ddba6a8821ea90a5080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:07Z,use_quota=True,user_id='cce85b9ae51b41ce9761d6f0451abbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Creating volume 852b3702-6d39-42e1-a71a-c3a4ea7e81b6 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:08 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:08 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 1073741824
Jul 31 15:07:08 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (bf363b78-195a-477f-b799-20c7ded3e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f170778b-8b9f-4db1-920f-1cc587a21646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f170778b-8b9f-4db1-920f-1cc587a21646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-294199425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0d34d1-88af-40f5-a358-756495a12262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:09Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08d0762-ef03-4717-b189-3a28ae63d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08d0762-ef03-4717-b189-3a28ae63d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6939ec-ddf5-4624-ad1c-5cf890ede92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6939ec-ddf5-4624-ad1c-5cf890ede92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0d34d1-88af-40f5-a358-756495a12262', 'volume_name': 'volume-ca0d34d1-88af-40f5-a358-756495a12262', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5680c7c2-0c76-4891-8cce-3f93b2447be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5680c7c2-0c76-4891-8cce-3f93b2447be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c91a8d2-d1d6-4d45-bfd1-9579681630fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:09 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Volume ca0d34d1-88af-40f5-a358-756495a12262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0d34d1-88af-40f5-a358-756495a12262', 'volume_size': 1}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:09 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 1073741824" returned: 0 in 0.426s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:09 devstack sudo[108185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6
Jul 31 15:07:09 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:09 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-294199425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0d34d1-88af-40f5-a358-756495a12262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:09Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Creating volume ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:09 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:09 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 1073741824
Jul 31 15:07:09 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Attempting download of e4964958-abb3-4d77-9fc0-35e3da4a86b0 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'metadata': {}}])) to volume 852b3702-6d39-42e1-a71a-c3a4ea7e81b6. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ba3c8-57b1-4884-93d1-119774823da3]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4964958-abb3-4d77-9fc0-35e3da4a86b0_343giztw {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:09 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4964958-abb3-4d77-9fc0-35e3da4a86b0_343giztw
Jul 31 15:07:09 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:09 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 1073741824" returned: 0 in 0.458s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:09 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4964958-abb3-4d77-9fc0-35e3da4a86b0_343giztw" returned: 0 in 0.389s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4964958-abb3-4d77-9fc0-35e3da4a86b0_343giztw {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:10 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262
Jul 31 15:07:10 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:10 devstack sudo[108197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4964958-abb3-4d77-9fc0-35e3da4a86b0_343giztw
Jul 31 15:07:10 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:10 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c91a8d2-d1d6-4d45-bfd1-9579681630fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0d34d1-88af-40f5-a358-756495a12262', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd56b819-b9f4-4f48-bb33-eb9c84fe0926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:10 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Volume volume-ca0d34d1-88af-40f5-a358-756495a12262 (ca0d34d1-88af-40f5-a358-756495a12262): created successfully
Jul 31 15:07:10 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd56b819-b9f4-4f48-bb33-eb9c84fe0926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (bf363b78-195a-477f-b799-20c7ded3e993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4964958-abb3-4d77-9fc0-35e3da4a86b0_343giztw" returned: 1 in 0.392s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4964958-abb3-4d77-9fc0-35e3da4a86b0_343giztw' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f534e-c51b-4048-91f4-47303969bea5]: (4, 'raw') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5f8c065b-0646-4474-948d-db9f64dc1cf4 tempest-ProjectReaderTests-859008750 None] Created volume successfully.
Jul 31 15:07:10 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD
Jul 31 15:07:10 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:10 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:10 devstack sudo[108208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD
Jul 31 15:07:10 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:11 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] e4964958-abb3-4d77-9fc0-35e3da4a86b0 was raw, converting to qcow2 {{(pid=88594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:11 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6
Jul 31 15:07:11 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Creating offline snapshot 7ff33325-10ec-4554-bca5-13f824e5698d of volume ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe1dcb-a235-4a67-8b34-6d0fdd478978]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:11 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262
Jul 31 15:07:11 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:11 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6" returned: 0 in 0.580s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4964958-abb3-4d77-9fc0-35e3da4a86b0_o5aycq2tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:07:11 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Converted 0.00 MB image at 0.00 MB/s
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:11 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 1G
Jul 31 15:07:11 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:11 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262" returned: 0 in 0.411s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:11 devstack sudo[108226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d 1G
Jul 31 15:07:11 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:11 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 1G" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Downloaded image e4964958-abb3-4d77-9fc0-35e3da4a86b0 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'metadata': {}}])) to volume 852b3702-6d39-42e1-a71a-c3a4ea7e81b6 successfully. {{(pid=88594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Temporary image e4964958-abb3-4d77-9fc0-35e3da4a86b0 for user cce85b9ae51b41ce9761d6f0451abbae is deleted. {{(pid=88594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 31 15:07:11 devstack cinder-volume[88594]: DEBUG cinder.volume.volume_utils [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Marking volume 852b3702-6d39-42e1-a71a-c3a4ea7e81b6 as bootable. {{(pid=88594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Copying metadata from image e4964958-abb3-4d77-9fc0-35e3da4a86b0 to 852b3702-6d39-42e1-a71a-c3a4ea7e81b6. {{(pid=88594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Creating volume glance metadata for volume 852b3702-6d39-42e1-a71a-c3a4ea7e81b6 backed by image e4964958-abb3-4d77-9fc0-35e3da4a86b0 with: {'image_id': 'e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '149537bd352651c50225d58734645832', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4386b30a-f380-4f24-8659-8bc88f40bf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6', 'volume_size': 1, 'image_id': 'e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '149537bd352651c50225d58734645832', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d314fadc0884ddba6a8821ea90a5080', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c456da1c80530f2e9eebcf45f548cd5f9ed5b48f8b426f5ae0d3a0df870eaf331faa5b7aa1a9d72d85848493126715cee2a2c25832aa792cbde571fed0526db', 'id': 'e4964958-abb3-4d77-9fc0-35e3da4a86b0', 'created_at': datetime.datetime(2026, 7, 31, 13, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 13, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4964958-abb3-4d77-9fc0-35e3da4a86b0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77cbda232ba0>}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e390d8-f9a6-4f65-abac-c2326cd52e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:12 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Volume volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 (852b3702-6d39-42e1-a71a-c3a4ea7e81b6): created successfully
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e390d8-f9a6-4f65-abac-c2326cd52e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Flow 'volume_create_manager' (d663baf3-0c1f-4e87-9ae8-037517700b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0101d5f8-34c8-4058-968a-076de4fae848 tempest-VolumeImageDependencyTests-1729309970 None] Created volume successfully.
Jul 31 15:07:12 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d 1G" returned: 0 in 0.463s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca0d34d1-88af-40f5-a358-756495a12262 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:12 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca0d34d1-88af-40f5-a358-756495a12262 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d
Jul 31 15:07:12 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:12 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca0d34d1-88af-40f5-a358-756495a12262 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d" returned: 0 in 0.300s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:12 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d is being set with open permissions: ugo+rw
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:12 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d
Jul 31 15:07:12 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:12 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d" returned: 0 in 0.259s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:12 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.info
Jul 31 15:07:12 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:13 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Acquiring lock "cinder-852b3702-6d39-42e1-a71a-c3a4ea7e81b6-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.info" returned: 0 in 0.294s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:13 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.info is being set with open permissions: ugo+rw
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Lock "cinder-852b3702-6d39-42e1-a71a-c3a4ea7e81b6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:13 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.info
Jul 31 15:07:13 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Acquiring lock "cinder-quobyte-852b3702-6d39-42e1-a71a-c3a4ea7e81b6" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Lock "cinder-quobyte-852b3702-6d39-42e1-a71a-c3a4ea7e81b6" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fe456a-74b0-403f-ba78-4886aaf8a486]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:13 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6
Jul 31 15:07:13 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:13 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.info" returned: 0 in 0.294s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:13 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6" returned: 0 in 0.409s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:13 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6
Jul 31 15:07:13 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:13 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0ee0dc67-6080-4d31-b8ca-bc318e875ba0 tempest-ProjectReaderTests-859008750 None] Create snapshot completed successfully
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Flow 'volume_create_manager' (92b63486-5768-4fb3-bf6c-601cb1f09037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:13 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a662cb92-27eb-48d3-be60-1cbf59775c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-852b3702-6d39-42e1-a71a-c3a4ea7e81b6" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a662cb92-27eb-48d3-be60-1cbf59775c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765523932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b9ef1-6fe4-454e-ba45-611c9f81b273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c93f2c28864833855f7efc7ed85c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:14Z,use_quota=True,user_id='c9ac6cfdeb5d4730b3bb39f42c73021c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad01675-dfca-4d6b-a53b-90a938efba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad01675-dfca-4d6b-a53b-90a938efba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e287c87-e0d5-4c60-997e-e11d182f63e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e287c87-e0d5-4c60-997e-e11d182f63e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108b9ef1-6fe4-454e-ba45-611c9f81b273', 'volume_name': 'volume-108b9ef1-6fe4-454e-ba45-611c9f81b273', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d8bdda-9cd5-4da7-9f2c-e91442d5ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d8bdda-9cd5-4da7-9f2c-e91442d5ac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0a7800-fe41-436c-915c-12bff150cd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:13 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Volume 108b9ef1-6fe4-454e-ba45-611c9f81b273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108b9ef1-6fe4-454e-ba45-611c9f81b273', 'volume_size': 1}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765523932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b9ef1-6fe4-454e-ba45-611c9f81b273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c93f2c28864833855f7efc7ed85c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:14Z,use_quota=True,user_id='c9ac6cfdeb5d4730b3bb39f42c73021c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Creating volume 108b9ef1-6fe4-454e-ba45-611c9f81b273 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:13 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Lock "cinder-quobyte-852b3702-6d39-42e1-a71a-c3a4ea7e81b6" released by "delete_volume" :: held 0.768s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:13 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273 1073741824
Jul 31 15:07:13 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:13 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Created reservations ['ebe10dde-6b54-401b-84bf-6e0c5bc6b495', '4cb39cfd-786f-48ee-8a7a-9db9ff47e967', '330b971b-6621-42e4-9e6d-ce0999d37eed', 'e950782f-33a5-4ee6-a3a4-eba1d8df86a4'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:14 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:14 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:14 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:14 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Deleted volume successfully.
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-38ea39b5-63a4-4655-af81-0c977cbba816 tempest-VolumeImageDependencyTests-1729309970 None] Lock "cinder-852b3702-6d39-42e1-a71a-c3a4ea7e81b6-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:14 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273 1073741824" returned: 0 in 0.515s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=207,cinder:UPDATE=280,cinder:INSERT=83,cinder:DELETE=30 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=285,cinder:SELECT=207,cinder:INSERT=68,cinder:DELETE=21 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:14 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273
Jul 31 15:07:14 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-7ff33325-10ec-4554-bca5-13f824e5698d-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Lock "cinder-7ff33325-10ec-4554-bca5-13f824e5698d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-ca0d34d1-88af-40f5-a358-756495a12262" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-ca0d34d1-88af-40f5-a358-756495a12262" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-7ff33325-10ec-4554-bca5-13f824e5698d" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-7ff33325-10ec-4554-bca5-13f824e5698d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Deleting offline snapshot 7ff33325-10ec-4554-bca5-13f824e5698d of volume ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] snapshot_file for this snap is: volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fff9fd2-b155-4cea-b164-d34ef4ca1d01]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:14 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273" returned: 0 in 0.359s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0a7800-fe41-436c-915c-12bff150cd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108b9ef1-6fe4-454e-ba45-611c9f81b273', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325c5e2d-f472-4847-9447-6a651f876615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:14 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Volume volume-108b9ef1-6fe4-454e-ba45-611c9f81b273 (108b9ef1-6fe4-454e-ba45-611c9f81b273): created successfully
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325c5e2d-f472-4847-9447-6a651f876615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:14 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Flow 'volume_create_manager' (92b63486-5768-4fb3-bf6c-601cb1f09037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:14 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b5fdbaed-69bb-46f6-b220-5d40e9597ff7 tempest-ProjectReaderTests-569480906 None] Created volume successfully.
Jul 31 15:07:14 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d
Jul 31 15:07:14 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:15 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d" returned: 0 in 0.404s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca0d34d1-88af-40f5-a358-756495a12262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:15 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd599d-774f-4cc3-9b3b-22cb8ba5cbc3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:15 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262
Jul 31 15:07:15 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:15 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262" returned: 0 in 0.410s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:15 devstack sudo[108282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d
Jul 31 15:07:15 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:16 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d" returned: 0 in 0.441s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:16 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d
Jul 31 15:07:16 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Acquiring lock "cinder-108b9ef1-6fe4-454e-ba45-611c9f81b273-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Lock "cinder-108b9ef1-6fe4-454e-ba45-611c9f81b273-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Acquiring lock "cinder-quobyte-108b9ef1-6fe4-454e-ba45-611c9f81b273" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Lock "cinder-quobyte-108b9ef1-6fe4-454e-ba45-611c9f81b273" acquired by "delete_volume" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[769a700e-a5a3-47a6-a789-a9923247f84d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:16 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262.7ff33325-10ec-4554-bca5-13f824e5698d" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-7ff33325-10ec-4554-bca5-13f824e5698d" released by "_delete_snapshot" :: held 1.660s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-ca0d34d1-88af-40f5-a358-756495a12262" released by "delete_snapshot" :: held 1.705s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:16 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273
Jul 31 15:07:16 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Created reservations ['6d1e8883-66f5-41e0-8cf5-eb8fb6a74b5a', '53d88381-abe3-40da-92ec-8a459cd88467', 'b5f9e8d4-2aaa-40f8-b47d-db7ae93ad6a2', '5b180012-f785-48a1-a56e-62f554ed6c83'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Delete snapshot completed successfully.
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-68a20977-bf48-456c-aae1-0fc9b0701291 tempest-ProjectReaderTests-859008750 None] Lock "cinder-7ff33325-10ec-4554-bca5-13f824e5698d-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:16 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273" returned: 0 in 0.398s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:16 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273
Jul 31 15:07:16 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-ca0d34d1-88af-40f5-a358-756495a12262-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Lock "cinder-ca0d34d1-88af-40f5-a358-756495a12262-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-ca0d34d1-88af-40f5-a358-756495a12262" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-ca0d34d1-88af-40f5-a358-756495a12262" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefcdf47-0ff1-45e7-a990-a0a7db83fcb9]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:16 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-108b9ef1-6fe4-454e-ba45-611c9f81b273" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Lock "cinder-quobyte-108b9ef1-6fe4-454e-ba45-611c9f81b273" released by "delete_volume" :: held 0.727s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Created reservations ['a275a6be-db24-4e27-88f9-30a8f8c9ffd5', '7a197645-bb8b-4126-abe2-39a3b033c4c7', 'b21b7cd0-9f5e-4c7a-aeb4-bc83d1173285', '07b5bb7d-5882-4ea6-8ac1-233b84adda94'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:17 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262
Jul 31 15:07:17 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:17 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:17 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:17 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:17 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262" returned: 0 in 0.442s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.296s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Deleted volume successfully.
Jul 31 15:07:17 devstack sudo[108307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262
Jul 31 15:07:17 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5db67afa-54cc-4105-bd37-054cd97b1930 tempest-ProjectReaderTests-569480906 None] Lock "cinder-108b9ef1-6fe4-454e-ba45-611c9f81b273-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:17 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ca0d34d1-88af-40f5-a358-756495a12262" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-ca0d34d1-88af-40f5-a358-756495a12262" released by "delete_volume" :: held 0.793s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Created reservations ['5da553f1-2594-4968-b583-edeadfb25006', '05bd1d03-2cc0-4a4f-8452-d60217205340', 'd1e3b1df-8334-44f1-a77d-c2a771494b6b', 'a70904bb-a67f-4958-8fc7-f1075d40f95d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:17 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:17 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Flow 'volume_create_manager' (a1a32b93-0fb4-43ca-8d1e-bd445d526973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe48dd-6880-433a-9e2f-0f6a4132218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe48dd-6880-433a-9e2f-0f6a4132218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182412200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce36f51-7b29-4102-83c6-9c9c3e473fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c93f2c28864833855f7efc7ed85c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:18Z,use_quota=True,user_id='c9ac6cfdeb5d4730b3bb39f42c73021c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a15e96-a01c-489e-bca8-a2e9eaa3568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a15e96-a01c-489e-bca8-a2e9eaa3568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bbac0f-ba68-4253-bc15-ad83a131102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bbac0f-ba68-4253-bc15-ad83a131102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce36f51-7b29-4102-83c6-9c9c3e473fbb', 'volume_name': 'volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035548c3-4cd0-40f1-92b1-b552eb8a86ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035548c3-4cd0-40f1-92b1-b552eb8a86ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7edc9a-e4ec-4409-825b-a1af4d964026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Volume 6ce36f51-7b29-4102-83c6-9c9c3e473fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb', 'volume_size': 1}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182412200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce36f51-7b29-4102-83c6-9c9c3e473fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c93f2c28864833855f7efc7ed85c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:18Z,use_quota=True,user_id='c9ac6cfdeb5d4730b3bb39f42c73021c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Creating volume 6ce36f51-7b29-4102-83c6-9c9c3e473fbb {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:18 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:18 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb 1073741824
Jul 31 15:07:18 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:18 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Deleted volume successfully.
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-c6a170d0-0de6-4c89-84f4-fee3b987b020 tempest-ProjectReaderTests-859008750 None] Lock "cinder-ca0d34d1-88af-40f5-a358-756495a12262-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:18 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb 1073741824" returned: 0 in 0.486s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:18 devstack sudo[108319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb
Jul 31 15:07:18 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (f5301e60-e925-4dcf-91da-ed0c51d5b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399c4a39-ce4f-4706-a6f6-44b64cc51139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399c4a39-ce4f-4706-a6f6-44b64cc51139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266094047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa3c655-4f58-441b-9ccb-4c9320748eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:19Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd964b8b-90ae-4eab-9623-5a4067868a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd964b8b-90ae-4eab-9623-5a4067868a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc04aecb-f35d-41c8-8408-c507e555cd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc04aecb-f35d-41c8-8408-c507e555cd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa3c655-4f58-441b-9ccb-4c9320748eca', 'volume_name': 'volume-5fa3c655-4f58-441b-9ccb-4c9320748eca', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7673085-774b-4ea9-a143-c52dcd1ed966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7673085-774b-4ea9-a143-c52dcd1ed966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b428a41-e279-45cb-b35a-3f2f6acef108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Volume 5fa3c655-4f58-441b-9ccb-4c9320748eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa3c655-4f58-441b-9ccb-4c9320748eca', 'volume_size': 1}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266094047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa3c655-4f58-441b-9ccb-4c9320748eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:19Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Creating volume 5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:18 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7edc9a-e4ec-4409-825b-a1af4d964026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca 1073741824
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53729105-0d3c-40ce-90c5-9d67af470b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (4f26bacb-425a-424a-9205-3ee921be09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c744838-8e3d-4644-be6f-59dc58a63c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Volume volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb (6ce36f51-7b29-4102-83c6-9c9c3e473fbb): created successfully
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53729105-0d3c-40ce-90c5-9d67af470b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Flow 'volume_create_manager' (a1a32b93-0fb4-43ca-8d1e-bd445d526973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c744838-8e3d-4644-be6f-59dc58a63c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938619164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05893602-5e95-4eb8-81ed-ded7274abfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:19Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d4807-485d-48d6-8099-f8de1edd101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d4807-485d-48d6-8099-f8de1edd101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c678942-08f7-424d-815f-2baaa1e96a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c678942-08f7-424d-815f-2baaa1e96a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05893602-5e95-4eb8-81ed-ded7274abfe0', 'volume_name': 'volume-05893602-5e95-4eb8-81ed-ded7274abfe0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4493e377-54a8-4ea3-8272-0751138d3dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:18 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4493e377-54a8-4ea3-8272-0751138d3dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ecb99d-110b-4d28-ba33-c6a8b6b20942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:19 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Volume 05893602-5e95-4eb8-81ed-ded7274abfe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05893602-5e95-4eb8-81ed-ded7274abfe0', 'volume_size': 1}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:19 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-dee84cec-5200-4a20-b83d-97119e79a00f tempest-ProjectReaderTests-569480906 None] Created volume successfully.
Jul 31 15:07:19 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca 1073741824" returned: 0 in 0.459s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:19 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca
Jul 31 15:07:19 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:19 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca" returned: 0 in 0.260s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938619164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05893602-5e95-4eb8-81ed-ded7274abfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:19Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Creating volume 05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:19 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:19 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 1073741824
Jul 31 15:07:19 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b428a41-e279-45cb-b35a-3f2f6acef108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa3c655-4f58-441b-9ccb-4c9320748eca', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d77e2f-4e2a-4cb0-a0c4-afafed616df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:19 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Volume volume-5fa3c655-4f58-441b-9ccb-4c9320748eca (5fa3c655-4f58-441b-9ccb-4c9320748eca): created successfully
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d77e2f-4e2a-4cb0-a0c4-afafed616df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:19 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (f5301e60-e925-4dcf-91da-ed0c51d5b59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:19 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3620b942-4a3e-4516-a08f-921b1ab510b2 tempest-ProjectReaderTests-859008750 None] Created volume successfully.
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Acquiring lock "cinder-6ce36f51-7b29-4102-83c6-9c9c3e473fbb-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Lock "cinder-6ce36f51-7b29-4102-83c6-9c9c3e473fbb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Acquiring lock "cinder-quobyte-6ce36f51-7b29-4102-83c6-9c9c3e473fbb" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Lock "cinder-quobyte-6ce36f51-7b29-4102-83c6-9c9c3e473fbb" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:20 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 1073741824" returned: 0 in 0.474s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[997eb3f0-a817-4937-8334-00a5715d18ff]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:20 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0
Jul 31 15:07:20 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:20 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb
Jul 31 15:07:20 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:20 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ecb99d-110b-4d28-ba33-c6a8b6b20942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05893602-5e95-4eb8-81ed-ded7274abfe0', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d07219-999a-4b07-9a73-108e27673790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:20 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Volume volume-05893602-5e95-4eb8-81ed-ded7274abfe0 (05893602-5e95-4eb8-81ed-ded7274abfe0): created successfully
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d07219-999a-4b07-9a73-108e27673790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (4f26bacb-425a-424a-9205-3ee921be09a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a4674875-70b4-46b2-8800-64de7c940eba tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:07:20 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb" returned: 0 in 0.361s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:20 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb
Jul 31 15:07:20 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:20 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6ce36f51-7b29-4102-83c6-9c9c3e473fbb" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Lock "cinder-quobyte-6ce36f51-7b29-4102-83c6-9c9c3e473fbb" released by "delete_volume" :: held 0.680s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Created reservations ['695cdbdb-7411-414b-ad97-041a79c51dc8', '6ecfb18a-5321-41ec-9c53-acc03536456b', '0cc623d5-6ac0-4408-87b2-f48c6cd8c5c3', '17f11e90-234d-4dc9-a0e5-e49bba18bbb3'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Creating offline snapshot 0512d5a9-defe-4223-9e02-379446e3a581 of volume 5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b133203b-ab93-4870-99dd-cd52b7a7ec12]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:20 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:21 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:21 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca
Jul 31 15:07:21 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:21 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.288s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:21 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Deleted volume successfully.
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-5a17306b-4c13-48cb-9554-cd76af4303e7 tempest-ProjectReaderTests-569480906 None] Lock "cinder-6ce36f51-7b29-4102-83c6-9c9c3e473fbb-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:21 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:21 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 1G
Jul 31 15:07:21 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:21 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 1G" returned: 0 in 0.418s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa3c655-4f58-441b-9ccb-4c9320748eca -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:21 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa3c655-4f58-441b-9ccb-4c9320748eca -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581
Jul 31 15:07:21 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:22 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa3c655-4f58-441b-9ccb-4c9320748eca -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581" returned: 0 in 0.295s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:22 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 is being set with open permissions: ugo+rw
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:22 devstack sudo[108402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581
Jul 31 15:07:22 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:22 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:22 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.info
Jul 31 15:07:22 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:22 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.info" returned: 0 in 0.269s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:22 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.info is being set with open permissions: ugo+rw
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:22 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.info
Jul 31 15:07:22 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:22 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.info" returned: 0 in 0.254s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.806s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot 2267ad69-3867-4e1b-ac99-c3e7e432c7a4 of volume 05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-88c355b9-d924-41b4-9a80-2d18e54c683c tempest-ProjectReaderTests-859008750 None] Create snapshot completed successfully
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb5cad-a89b-4f45-b840-6553b7b4ae15]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:23 devstack sudo[108412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0
Jul 31 15:07:23 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:23 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0" returned: 0 in 0.376s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:23 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 1G
Jul 31 15:07:23 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:23 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 1G" returned: 0 in 0.431s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05893602-5e95-4eb8-81ed-ded7274abfe0 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:23 devstack sudo[108422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05893602-5e95-4eb8-81ed-ded7274abfe0 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4
Jul 31 15:07:23 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-0512d5a9-defe-4223-9e02-379446e3a581-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Lock "cinder-0512d5a9-defe-4223-9e02-379446e3a581-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-5fa3c655-4f58-441b-9ccb-4c9320748eca" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-5fa3c655-4f58-441b-9ccb-4c9320748eca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-0512d5a9-defe-4223-9e02-379446e3a581" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-0512d5a9-defe-4223-9e02-379446e3a581" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:24 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Deleting offline snapshot 0512d5a9-defe-4223-9e02-379446e3a581 of volume 5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] snapshot_file for this snap is: volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05893602-5e95-4eb8-81ed-ded7274abfe0 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4" returned: 0 in 0.370s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:24 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 is being set with open permissions: ugo+rw
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b088192-c68a-49e2-9059-43e7abcd738b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:24 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4
Jul 31 15:07:24 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:24 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581
Jul 31 15:07:24 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:24 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4" returned: 0 in 0.265s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:24 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.info
Jul 31 15:07:24 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:24 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581" returned: 0 in 0.450s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fa3c655-4f58-441b-9ccb-4c9320748eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a5ef48-bb90-4ffb-8289-5d54d305f5fa]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:24 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.info" returned: 0 in 0.287s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:24 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.info is being set with open permissions: ugo+rw
Jul 31 15:07:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:24 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca
Jul 31 15:07:24 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:24 devstack sudo[108441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.info
Jul 31 15:07:24 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:25 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.info" returned: 0 in 0.308s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:25 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca" returned: 0 in 0.494s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bc64ab0a-333c-44df-9034-551b6af765a0 tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:07:25 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581
Jul 31 15:07:25 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-2267ad69-3867-4e1b-ac99-c3e7e432c7a4-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Lock "cinder-2267ad69-3867-4e1b-ac99-c3e7e432c7a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-05893602-5e95-4eb8-81ed-ded7274abfe0" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-05893602-5e95-4eb8-81ed-ded7274abfe0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-2267ad69-3867-4e1b-ac99-c3e7e432c7a4" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-2267ad69-3867-4e1b-ac99-c3e7e432c7a4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot 2267ad69-3867-4e1b-ac99-c3e7e432c7a4 of volume 05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[963f519e-ddfb-4b3f-8964-dd04ba2563b3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:25 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581" returned: 0 in 0.383s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:25 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4
Jul 31 15:07:25 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:25 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581
Jul 31 15:07:25 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:25 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca.0512d5a9-defe-4223-9e02-379446e3a581" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:25 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4" returned: 0 in 0.397s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05893602-5e95-4eb8-81ed-ded7274abfe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-0512d5a9-defe-4223-9e02-379446e3a581" released by "_delete_snapshot" :: held 1.744s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-5fa3c655-4f58-441b-9ccb-4c9320748eca" released by "delete_snapshot" :: held 1.773s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169a623-b8c0-48c0-a023-f57de991b81e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Created reservations ['86caf8b1-f1ce-4bd6-a87c-e998d9ac1e86', '53283710-994c-40c8-b81f-37d2bac51020', '38361077-c4ac-4eca-babd-fde81f33d5e7', '7b1110a3-8726-4c85-b54c-3d8b5f26c3a9'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:25 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0
Jul 31 15:07:25 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Delete snapshot completed successfully.
Jul 31 15:07:25 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-08b71f18-b037-4bd9-b17c-eb47873420dd tempest-ProjectReaderTests-859008750 None] Lock "cinder-0512d5a9-defe-4223-9e02-379446e3a581-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-5fa3c655-4f58-441b-9ccb-4c9320748eca-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Lock "cinder-5fa3c655-4f58-441b-9ccb-4c9320748eca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-5fa3c655-4f58-441b-9ccb-4c9320748eca" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:26 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0" returned: 0 in 0.439s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-5fa3c655-4f58-441b-9ccb-4c9320748eca" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:26 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4
Jul 31 15:07:26 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac67fbe-ecc1-4be2-88f7-a2a0ad75627f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:26 devstack sudo[108468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca
Jul 31 15:07:26 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:26 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4" returned: 0 in 0.412s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:26 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4
Jul 31 15:07:26 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:26 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca" returned: 0 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:26 devstack sudo[108484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca
Jul 31 15:07:26 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:26 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0.2267ad69-3867-4e1b-ac99-c3e7e432c7a4" returned: 0 in 0.266s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-2267ad69-3867-4e1b-ac99-c3e7e432c7a4" released by "_delete_snapshot" :: held 1.655s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:27 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-5fa3c655-4f58-441b-9ccb-4c9320748eca" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-05893602-5e95-4eb8-81ed-ded7274abfe0" released by "delete_snapshot" :: held 1.694s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-5fa3c655-4f58-441b-9ccb-4c9320748eca" released by "delete_volume" :: held 0.750s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Created reservations ['b91b5c68-1c14-4e2f-a6a0-7b7c467cf819', '712fe6b4-008c-4377-ba56-680e156a54b1', '91b1d9f8-abb0-405b-a30f-ee8a83fb6374', '69081777-2c1b-4af8-b818-010c9b0fa7d8'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Created reservations ['95aa7455-8cee-4575-b0f8-1dd64485b444', '9be54026-cea9-4916-9dd1-f76995390426', '3b554945-9009-462e-96af-5081a7123c72', 'ddb941ea-237b-44af-90e7-3c9f55406dfc'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-942297ec-2106-4db4-9932-d41e609294db tempest-ProjectMemberTests-1779150627 None] Lock "cinder-2267ad69-3867-4e1b-ac99-c3e7e432c7a4-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:27 devstack sudo[108488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:27 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:27 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.282s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-05893602-5e95-4eb8-81ed-ded7274abfe0-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Deleted volume successfully.
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-05893602-5e95-4eb8-81ed-ded7274abfe0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2fbcfc93-3172-463c-9e6a-d28d9450d93d tempest-ProjectReaderTests-859008750 None] Lock "cinder-5fa3c655-4f58-441b-9ccb-4c9320748eca-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-05893602-5e95-4eb8-81ed-ded7274abfe0" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-05893602-5e95-4eb8-81ed-ded7274abfe0" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c3facb-2190-4e11-a919-198bdaa64c28]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:27 devstack sudo[108491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0
Jul 31 15:07:27 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (2e9f0114-b79d-451d-acce-96bd091624c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e842808-30de-4061-8790-054e1271c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:27 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e842808-30de-4061-8790-054e1271c275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89729513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf94acae-b406-4dbc-8009-7fab252fc6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:28Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9275e1ff-49a6-482c-a74e-ac9fedf7de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9275e1ff-49a6-482c-a74e-ac9fedf7de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d03efc0-ff05-4ec7-9079-d1527dd2df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d03efc0-ff05-4ec7-9079-d1527dd2df21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf94acae-b406-4dbc-8009-7fab252fc6c4', 'volume_name': 'volume-cf94acae-b406-4dbc-8009-7fab252fc6c4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc392f9-68a3-4e1a-9c61-0d9c51528e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc392f9-68a3-4e1a-9c61-0d9c51528e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00af06b5-926c-4b12-a2ea-f2cac342da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:28 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Volume cf94acae-b406-4dbc-8009-7fab252fc6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf94acae-b406-4dbc-8009-7fab252fc6c4', 'volume_size': 1}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89729513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf94acae-b406-4dbc-8009-7fab252fc6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:28Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Creating volume cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:28 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:28 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 1073741824
Jul 31 15:07:28 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:28 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:28 devstack sudo[108498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0
Jul 31 15:07:28 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:28 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-05893602-5e95-4eb8-81ed-ded7274abfe0" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-05893602-5e95-4eb8-81ed-ded7274abfe0" released by "delete_volume" :: held 0.751s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Created reservations ['882ddfa5-e77a-4044-b300-2d4fb1ce7b7b', '5a37e0fe-cfe5-4b43-bfc0-a2f0da8ea11e', '54ed80ef-75fe-4bbc-9ee8-089a315c9663', '03962cb0-771e-44d1-980d-792a058c7b11'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:28 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 1073741824" returned: 0 in 0.533s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:28 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:28 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:28 devstack sudo[108507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4
Jul 31 15:07:28 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:28 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.429s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:28 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-d18c38a9-63b6-42cb-a229-94c6623f69c3 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-05893602-5e95-4eb8-81ed-ded7274abfe0-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:29 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4" returned: 0 in 0.431s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00af06b5-926c-4b12-a2ea-f2cac342da22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf94acae-b406-4dbc-8009-7fab252fc6c4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf6230-c6cc-4f77-8ef5-ea45c25f7973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Volume volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 (cf94acae-b406-4dbc-8009-7fab252fc6c4): created successfully
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf6230-c6cc-4f77-8ef5-ea45c25f7973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (2e9f0114-b79d-451d-acce-96bd091624c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d6f5b34c-fbee-49dd-83b6-d28a49fdeebd tempest-ProjectReaderTests-859008750 None] Created volume successfully.
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (5c2997b3-fd31-46c6-854e-d428bb7bb834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9796c7b0-3d3d-4bc2-aade-e147f4652014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9796c7b0-3d3d-4bc2-aade-e147f4652014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985800602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f238b9b-b259-485e-b8d6-69d1faa8b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:29Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2688153-ee8d-4ca0-8fb2-314d9a65b3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2688153-ee8d-4ca0-8fb2-314d9a65b3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc575af4-1b9a-49e2-a6c6-22880796b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc575af4-1b9a-49e2-a6c6-22880796b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f238b9b-b259-485e-b8d6-69d1faa8b681', 'volume_name': 'volume-8f238b9b-b259-485e-b8d6-69d1faa8b681', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd76944-ebfe-4ea4-a3c8-706228a3e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd76944-ebfe-4ea4-a3c8-706228a3e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae3c2dd-4956-48b1-b3f8-0d5b71c11df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:29 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Volume 8f238b9b-b259-485e-b8d6-69d1faa8b681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f238b9b-b259-485e-b8d6-69d1faa8b681', 'volume_size': 1}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985800602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f238b9b-b259-485e-b8d6-69d1faa8b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:29Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Creating volume 8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:29 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:29 devstack sudo[108511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 1073741824
Jul 31 15:07:29 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:29 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 1073741824" returned: 0 in 0.460s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:30 devstack sudo[108517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681
Jul 31 15:07:30 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:30 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681" returned: 0 in 0.309s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae3c2dd-4956-48b1-b3f8-0d5b71c11df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f238b9b-b259-485e-b8d6-69d1faa8b681', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c67cf48-2c9e-4e37-88f9-c0fcb94bf092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:30 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Volume volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 (8f238b9b-b259-485e-b8d6-69d1faa8b681): created successfully
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c67cf48-2c9e-4e37-88f9-c0fcb94bf092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (5c2997b3-fd31-46c6-854e-d428bb7bb834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Creating offline snapshot 7c7caf9f-0388-4d80-a42d-226d9382fbe6 of volume cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:30 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0e90c878-fa57-4c2b-9dfc-664e5e40d8f7 tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bc5a4a-a4eb-4cd5-a900-c2fcdacc3fc8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:30 devstack sudo[108520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4
Jul 31 15:07:30 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:30 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4" returned: 0 in 0.430s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:30 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 1G
Jul 31 15:07:30 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:31 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 1G" returned: 0 in 0.457s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:31 devstack sudo[108533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6
Jul 31 15:07:31 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:31 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6" returned: 0 in 0.350s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:31 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 is being set with open permissions: ugo+rw
Jul 31 15:07:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:31 devstack sudo[108538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6
Jul 31 15:07:31 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:31 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:31 devstack sudo[108541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.info
Jul 31 15:07:31 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:32 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.info" returned: 0 in 0.259s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:32 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.info is being set with open permissions: ugo+rw
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:32 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.info
Jul 31 15:07:32 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:32 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.info" returned: 0 in 0.257s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.744s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot 74461164-e6f0-42dd-acbf-2ffff95de0cd of volume 8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bde29c01-85aa-4b96-9049-3a3a3bcb4683 tempest-ProjectReaderTests-859008750 None] Create snapshot completed successfully
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[71babb3c-7718-4067-9f87-df83af5c4a18]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:32 devstack sudo[108547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681
Jul 31 15:07:32 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:32 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681" returned: 0 in 0.388s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:32 devstack sudo[108553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd 1G
Jul 31 15:07:32 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:33 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd 1G" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:33 devstack sudo[108558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd
Jul 31 15:07:33 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-7c7caf9f-0388-4d80-a42d-226d9382fbe6-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Lock "cinder-7c7caf9f-0388-4d80-a42d-226d9382fbe6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-cf94acae-b406-4dbc-8009-7fab252fc6c4" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-cf94acae-b406-4dbc-8009-7fab252fc6c4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-7c7caf9f-0388-4d80-a42d-226d9382fbe6" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-7c7caf9f-0388-4d80-a42d-226d9382fbe6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Deleting offline snapshot 7c7caf9f-0388-4d80-a42d-226d9382fbe6 of volume cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] snapshot_file for this snap is: volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d3be03-2aaa-498e-8329-5cf46f0a0580]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:33 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd" returned: 0 in 0.352s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:33 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd is being set with open permissions: ugo+rw
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:33 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd
Jul 31 15:07:33 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:33 devstack sudo[108563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6
Jul 31 15:07:33 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:33 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd" returned: 0 in 0.285s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:33 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6" returned: 0 in 0.404s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf94acae-b406-4dbc-8009-7fab252fc6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:34 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.info
Jul 31 15:07:34 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[540f1b0a-a3ab-4bd0-9440-2ab08de67742]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:34 devstack sudo[108573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4
Jul 31 15:07:34 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:34 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.info" returned: 0 in 0.285s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:34 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.info is being set with open permissions: ugo+rw
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:34 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.info
Jul 31 15:07:34 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:34 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4" returned: 0 in 0.444s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:34 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6
Jul 31 15:07:34 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:34 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.info" returned: 0 in 0.384s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-d660edef-1b04-4732-98c9-6e9d779f1d5e tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-74461164-e6f0-42dd-acbf-2ffff95de0cd-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:34 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6" returned: 0 in 0.416s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-74461164-e6f0-42dd-acbf-2ffff95de0cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-8f238b9b-b259-485e-b8d6-69d1faa8b681" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:34 devstack sudo[108587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6
Jul 31 15:07:34 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8f238b9b-b259-485e-b8d6-69d1faa8b681" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-74461164-e6f0-42dd-acbf-2ffff95de0cd" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-74461164-e6f0-42dd-acbf-2ffff95de0cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot 74461164-e6f0-42dd-acbf-2ffff95de0cd of volume 8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7560ff-1dea-47f0-8204-fed3a707b364]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:35 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd
Jul 31 15:07:35 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:35 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4.7c7caf9f-0388-4d80-a42d-226d9382fbe6" returned: 0 in 0.347s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-7c7caf9f-0388-4d80-a42d-226d9382fbe6" released by "_delete_snapshot" :: held 1.721s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-cf94acae-b406-4dbc-8009-7fab252fc6c4" released by "delete_snapshot" :: held 1.750s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Created reservations ['c2be4274-7f9d-4b2d-bca4-b4fb4038a049', 'c8973bae-1cbb-4f38-b89e-95223e206f41', 'c244559a-ee58-46f3-bfb1-355d6933398c', '0ebdf6fa-9acf-4d76-bab3-0eaee037e408'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:35 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Delete snapshot completed successfully.
Jul 31 15:07:35 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61219aaf-2317-48bc-9bbc-91887c38c602 tempest-ProjectReaderTests-859008750 None] Lock "cinder-7c7caf9f-0388-4d80-a42d-226d9382fbe6-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd" returned: 0 in 0.451s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f238b9b-b259-485e-b8d6-69d1faa8b681(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58161a57-637b-4f1d-bfe4-03ff859d6e7f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:35 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681
Jul 31 15:07:35 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-cf94acae-b406-4dbc-8009-7fab252fc6c4-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Lock "cinder-cf94acae-b406-4dbc-8009-7fab252fc6c4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-cf94acae-b406-4dbc-8009-7fab252fc6c4" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-cf94acae-b406-4dbc-8009-7fab252fc6c4" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eefeef-a4a0-479f-9a7f-855f86dc71c7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:35 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681" returned: 0 in 0.444s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:35 devstack sudo[108599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4
Jul 31 15:07:35 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:35 devstack sudo[108601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd
Jul 31 15:07:35 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:36 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4" returned: 0 in 0.422s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:36 devstack sudo[108610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4
Jul 31 15:07:36 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:36 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:36 devstack sudo[108612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd
Jul 31 15:07:36 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:36 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-cf94acae-b406-4dbc-8009-7fab252fc6c4" returned: 0 in 0.298s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:36 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681.74461164-e6f0-42dd-acbf-2ffff95de0cd" returned: 0 in 0.261s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-cf94acae-b406-4dbc-8009-7fab252fc6c4" released by "delete_volume" :: held 0.806s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-74461164-e6f0-42dd-acbf-2ffff95de0cd" released by "_delete_snapshot" :: held 1.696s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8f238b9b-b259-485e-b8d6-69d1faa8b681" released by "delete_snapshot" :: held 1.723s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Created reservations ['3569dbe4-785d-4015-a837-c4782d1ee4bd', '6a7979b0-496a-407b-9e8d-1a98880f1e4b', '6cf1b257-d5e7-435e-9904-32778919a8ba', 'eeb90ba6-9e2d-43b4-870e-28d83484ab3f'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Created reservations ['d5a12b78-58cf-4831-ad19-9ce32e6dc55f', '4f240ce1-ecbf-4149-b915-4cb3b652395c', '1cffc935-05e2-4ece-91ba-c670141644f0', '525750ed-7a44-4a78-9e3f-3e3dc07fd863'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:36 devstack sudo[108616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:36 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:07:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-33806f3e-a9d5-4a63-b362-49648db5c41f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-74461164-e6f0-42dd-acbf-2ffff95de0cd-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-8f238b9b-b259-485e-b8d6-69d1faa8b681-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-8f238b9b-b259-485e-b8d6-69d1faa8b681-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-8f238b9b-b259-485e-b8d6-69d1faa8b681" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:37 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8f238b9b-b259-485e-b8d6-69d1faa8b681" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:37 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Deleted volume successfully.
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d56fa48-e9ac-420c-b8b0-ce7b9de52d5d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0e6e5e2a-f2a0-4f2c-850f-d25cbd641ef2 tempest-ProjectReaderTests-859008750 None] Lock "cinder-cf94acae-b406-4dbc-8009-7fab252fc6c4-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:37 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681
Jul 31 15:07:37 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:37 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681" returned: 0 in 0.382s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:37 devstack sudo[108627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681
Jul 31 15:07:37 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:37 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8f238b9b-b259-485e-b8d6-69d1faa8b681" returned: 0 in 0.275s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8f238b9b-b259-485e-b8d6-69d1faa8b681" released by "delete_volume" :: held 0.737s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Created reservations ['5bb6c08a-b45a-4df9-8853-d20562feafc2', 'ae97b618-0f16-43b2-9f1f-8f80e0e2b736', 'f8a8d76c-3234-46cb-ba80-75f495867664', '49bb5803-0fad-4729-8de7-d14fdb33af3e'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:38 devstack sudo[108630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:38 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:38 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.285s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0a04cf1b-1c01-4ff4-9ba4-2c7def323b37 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-8f238b9b-b259-485e-b8d6-69d1faa8b681-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (c288a8e1-21d7-47dc-be38-856003df1d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc21056-65f6-455f-9bb5-3fd529fa552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc21056-65f6-455f-9bb5-3fd529fa552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053596339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4316677-3eb7-4f78-979d-6391ed0a0097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:39Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51066fb-0218-431b-948d-ca2d368f6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51066fb-0218-431b-948d-ca2d368f6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579d752e-c9f9-453e-9adb-266d8c0c4d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579d752e-c9f9-453e-9adb-266d8c0c4d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4316677-3eb7-4f78-979d-6391ed0a0097', 'volume_name': 'volume-a4316677-3eb7-4f78-979d-6391ed0a0097', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783df74b-c51f-4a3b-a1f4-0fad717b4852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783df74b-c51f-4a3b-a1f4-0fad717b4852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f147771-dc0f-4ca3-805b-1f11a1948e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Volume a4316677-3eb7-4f78-979d-6391ed0a0097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4316677-3eb7-4f78-979d-6391ed0a0097', 'volume_size': 1}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053596339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4316677-3eb7-4f78-979d-6391ed0a0097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:39Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Creating volume a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:38 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:38 devstack sudo[108633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 1073741824
Jul 31 15:07:38 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (637b0613-99ec-4c09-8420-753b959d1462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75e36d4-e77b-419c-82f8-51df819798fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75e36d4-e77b-419c-82f8-51df819798fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227398203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fef1d5c-90e7-448f-8990-5052025f0e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:39Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d749411-55d2-4067-8846-7713c5d49e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d749411-55d2-4067-8846-7713c5d49e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81375012-db17-4365-baf5-1f229687442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81375012-db17-4365-baf5-1f229687442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fef1d5c-90e7-448f-8990-5052025f0e9d', 'volume_name': 'volume-6fef1d5c-90e7-448f-8990-5052025f0e9d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf7910f-66f5-4a32-ba90-500b4b2dc24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf7910f-66f5-4a32-ba90-500b4b2dc24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca81ce9-de87-4dbc-8f26-4a420efce3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Volume 6fef1d5c-90e7-448f-8990-5052025f0e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fef1d5c-90e7-448f-8990-5052025f0e9d', 'volume_size': 1}
Jul 31 15:07:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:39 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 1073741824" returned: 0 in 0.474s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:39 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097
Jul 31 15:07:39 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:39 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227398203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fef1d5c-90e7-448f-8990-5052025f0e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:39Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Creating volume 6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:39 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f147771-dc0f-4ca3-805b-1f11a1948e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4316677-3eb7-4f78-979d-6391ed0a0097', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2babbf-4a97-47f2-8c30-f33cdf969b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:39 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d 1073741824
Jul 31 15:07:39 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Volume volume-a4316677-3eb7-4f78-979d-6391ed0a0097 (a4316677-3eb7-4f78-979d-6391ed0a0097): created successfully
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2babbf-4a97-47f2-8c30-f33cdf969b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (c288a8e1-21d7-47dc-be38-856003df1d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-5c48d91b-3a65-4f76-bfef-d143b8ea9c98 tempest-ProjectReaderTests-859008750 None] Created volume successfully.
Jul 31 15:07:39 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d 1073741824" returned: 0 in 0.451s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:39 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d
Jul 31 15:07:39 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:40 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca81ce9-de87-4dbc-8f26-4a420efce3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fef1d5c-90e7-448f-8990-5052025f0e9d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f13207-eaae-400f-9910-047e0cc20769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:40 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Volume volume-6fef1d5c-90e7-448f-8990-5052025f0e9d (6fef1d5c-90e7-448f-8990-5052025f0e9d): created successfully
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f13207-eaae-400f-9910-047e0cc20769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (637b0613-99ec-4c09-8420-753b959d1462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:40 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-872f4031-71a5-4d3c-b0a5-a5e43d3d023f tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Creating offline snapshot 21b1c547-83ee-41fc-a09a-b013f222f619 of volume a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e3bad-2509-4db1-a05d-85474e9b0862]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:40 devstack sudo[108652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097
Jul 31 15:07:40 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:41 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097" returned: 0 in 0.431s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:41 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 1G
Jul 31 15:07:41 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:41 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 1G" returned: 0 in 0.458s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4316677-3eb7-4f78-979d-6391ed0a0097 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:41 devstack sudo[108663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4316677-3eb7-4f78-979d-6391ed0a0097 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619
Jul 31 15:07:41 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:42 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4316677-3eb7-4f78-979d-6391ed0a0097 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619" returned: 0 in 0.332s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:42 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 is being set with open permissions: ugo+rw
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:42 devstack sudo[108668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619
Jul 31 15:07:42 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:42 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:42 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.info
Jul 31 15:07:42 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:42 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.info" returned: 0 in 0.287s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:42 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.info is being set with open permissions: ugo+rw
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:42 devstack sudo[108675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.info
Jul 31 15:07:42 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:42 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.info" returned: 0 in 0.259s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.816s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot aa1ba6ad-79c1-4ac7-a303-43f117254e5a of volume 6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e2bbb5aa-52ec-4fa1-b01c-09e26b3b79dd tempest-ProjectReaderTests-859008750 None] Create snapshot completed successfully
Jul 31 15:07:43 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f38b866-31c5-40de-93b9-3dd29cacf950]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:43 devstack sudo[108678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d
Jul 31 15:07:43 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:43 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d" returned: 0 in 0.410s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:43 devstack sudo[108683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a 1G
Jul 31 15:07:43 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:43 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a 1G" returned: 0 in 0.418s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fef1d5c-90e7-448f-8990-5052025f0e9d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:43 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fef1d5c-90e7-448f-8990-5052025f0e9d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a
Jul 31 15:07:43 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-21b1c547-83ee-41fc-a09a-b013f222f619-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Lock "cinder-21b1c547-83ee-41fc-a09a-b013f222f619-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-a4316677-3eb7-4f78-979d-6391ed0a0097" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-a4316677-3eb7-4f78-979d-6391ed0a0097" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-21b1c547-83ee-41fc-a09a-b013f222f619" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-21b1c547-83ee-41fc-a09a-b013f222f619" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Deleting offline snapshot 21b1c547-83ee-41fc-a09a-b013f222f619 of volume a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] snapshot_file for this snap is: volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a273c87-e961-4c78-b298-0bc36263fc90]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:44 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fef1d5c-90e7-448f-8990-5052025f0e9d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a" returned: 0 in 0.364s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:44 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a is being set with open permissions: ugo+rw
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:44 devstack sudo[108693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619
Jul 31 15:07:44 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:44 devstack sudo[108696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a
Jul 31 15:07:44 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:44 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:44 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619" returned: 0 in 0.407s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4316677-3eb7-4f78-979d-6391ed0a0097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:44 devstack sudo[108704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.info
Jul 31 15:07:44 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc44aaa-1b3a-48c4-8ed4-39ebe6e070c4]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:44 devstack sudo[108706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097
Jul 31 15:07:44 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:44 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.info" returned: 0 in 0.304s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:44 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.info is being set with open permissions: ugo+rw
Jul 31 15:07:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:44 devstack sudo[108709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.info
Jul 31 15:07:44 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:45 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097" returned: 0 in 0.440s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:45 devstack sudo[108714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619
Jul 31 15:07:45 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:45 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.info" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0010b191-8a4d-4779-ac18-5f51a2decba6 tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-aa1ba6ad-79c1-4ac7-a303-43f117254e5a-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-aa1ba6ad-79c1-4ac7-a303-43f117254e5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-6fef1d5c-90e7-448f-8990-5052025f0e9d" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:45 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-6fef1d5c-90e7-448f-8990-5052025f0e9d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-aa1ba6ad-79c1-4ac7-a303-43f117254e5a" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619" returned: 0 in 0.435s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-aa1ba6ad-79c1-4ac7-a303-43f117254e5a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot aa1ba6ad-79c1-4ac7-a303-43f117254e5a of volume 6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:45 devstack sudo[108721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619
Jul 31 15:07:45 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d8468f-81ec-426a-b51f-cf34e580b385]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:45 devstack sudo[108723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a
Jul 31 15:07:45 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:45 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097.21b1c547-83ee-41fc-a09a-b013f222f619" returned: 0 in 0.285s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-21b1c547-83ee-41fc-a09a-b013f222f619" released by "_delete_snapshot" :: held 1.696s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-a4316677-3eb7-4f78-979d-6391ed0a0097" released by "delete_snapshot" :: held 1.728s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Created reservations ['e3464700-9290-4a5b-a4b3-025bb9b96ce1', 'da05c23d-5905-42a4-bddd-966d137d32e5', '3a8b351a-5f5e-4307-8652-c8f39de8f1df', '9b69f65d-af99-4da1-bba5-d59ee3644738'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Delete snapshot completed successfully.
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-0f54653f-964c-44cb-9af9-eee42a7d1660 tempest-ProjectReaderTests-859008750 None] Lock "cinder-21b1c547-83ee-41fc-a09a-b013f222f619-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:45 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fef1d5c-90e7-448f-8990-5052025f0e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a1f43b-2cea-4ea8-8f2a-952e52d96930]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:46 devstack sudo[108731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d
Jul 31 15:07:46 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-a4316677-3eb7-4f78-979d-6391ed0a0097-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Lock "cinder-a4316677-3eb7-4f78-979d-6391ed0a0097-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-a4316677-3eb7-4f78-979d-6391ed0a0097" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-a4316677-3eb7-4f78-979d-6391ed0a0097" acquired by "delete_volume" :: waited 0.025s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7260659-ce5e-425b-9851-c571c557699b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:46 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d" returned: 0 in 0.440s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:46 devstack sudo[108735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097
Jul 31 15:07:46 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:46 devstack sudo[108737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a
Jul 31 15:07:46 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:46 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097" returned: 0 in 0.428s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:46 devstack sudo[108747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097
Jul 31 15:07:46 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:46 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:46 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:46 devstack sudo[108749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a
Jul 31 15:07:46 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:47 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a4316677-3eb7-4f78-979d-6391ed0a0097" returned: 0 in 0.278s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-a4316677-3eb7-4f78-979d-6391ed0a0097" released by "delete_volume" :: held 0.790s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:47 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d.aa1ba6ad-79c1-4ac7-a303-43f117254e5a" returned: 0 in 0.296s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-aa1ba6ad-79c1-4ac7-a303-43f117254e5a" released by "_delete_snapshot" :: held 1.705s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-6fef1d5c-90e7-448f-8990-5052025f0e9d" released by "delete_snapshot" :: held 1.743s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Created reservations ['2ce0d1d6-1b7c-4120-9a44-d72bab6c1f7b', 'b33b0f52-43a2-4759-a412-3457759cee77', '20292a89-3983-4ccc-86a6-af2283c28760', '60d254ea-a623-48db-8f5e-406210772667'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Created reservations ['16d3f316-9622-45a0-85d0-b4ff61ba9f06', '0034e815-c312-48ff-a237-37c51db44918', '3381c8bc-241e-463a-a7b8-51770775a944', '3d445bc1-2df5-4ae0-8fd9-e2ea11a053bb'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:47 devstack sudo[108753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:47 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b638c168-8a80-4823-808d-93c71ee19b3c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-aa1ba6ad-79c1-4ac7-a303-43f117254e5a-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:47 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.321s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:47 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Deleted volume successfully.
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1092229b-e8cd-4235-a35b-f815f06ff441 tempest-ProjectReaderTests-859008750 None] Lock "cinder-a4316677-3eb7-4f78-979d-6391ed0a0097-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-6fef1d5c-90e7-448f-8990-5052025f0e9d-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-6fef1d5c-90e7-448f-8990-5052025f0e9d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-6fef1d5c-90e7-448f-8990-5052025f0e9d" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:47 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-6fef1d5c-90e7-448f-8990-5052025f0e9d" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae606662-4102-455a-8457-16f6accab033]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:48 devstack sudo[108758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d
Jul 31 15:07:48 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (53a5596e-aabd-4936-b376-1480f9c6e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874f4dd3-9d72-4ed7-a292-b0646cb462e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874f4dd3-9d72-4ed7-a292-b0646cb462e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572581742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882e25d1-7f64-429b-af02-a8df1ab23a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:48Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e79efd1-df76-4407-b3f7-48ba2a016efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e79efd1-df76-4407-b3f7-48ba2a016efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6202a65a-e088-4c3f-8cbd-2ed9df43a8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6202a65a-e088-4c3f-8cbd-2ed9df43a8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882e25d1-7f64-429b-af02-a8df1ab23a3d', 'volume_name': 'volume-882e25d1-7f64-429b-af02-a8df1ab23a3d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22fed2e-5eed-42e5-9799-e6056e87a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22fed2e-5eed-42e5-9799-e6056e87a012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65374945-7b6b-490b-b246-fac5f9d6707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Volume 882e25d1-7f64-429b-af02-a8df1ab23a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882e25d1-7f64-429b-af02-a8df1ab23a3d', 'volume_size': 1}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572581742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882e25d1-7f64-429b-af02-a8df1ab23a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a50dcba8c744cfaa14240f980553c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:48Z,use_quota=True,user_id='c599510fae3e438a90cc2c8681e101c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Creating volume 882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:48 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:48 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d 1073741824
Jul 31 15:07:48 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:48 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d" returned: 0 in 0.536s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:48 devstack sudo[108766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d
Jul 31 15:07:48 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:48 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-6fef1d5c-90e7-448f-8990-5052025f0e9d" returned: 0 in 0.284s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Flow 'volume_create_manager' (5b060fae-98a3-4554-a7ac-6f6db80b8ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f17eb16-4a0c-4f5a-ab49-9b0bde9491d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-6fef1d5c-90e7-448f-8990-5052025f0e9d" released by "delete_volume" :: held 0.968s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f17eb16-4a0c-4f5a-ab49-9b0bde9491d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1397165950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef49e6a7-83b6-4752-8a91-b003c99e662b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5bd5e074f14c3493c7faef7da9a64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:49Z,use_quota=True,user_id='714cc0085d384fe9a937c0b7b4a6a975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94efc04-f30f-438a-a23f-6b44aa26eabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94efc04-f30f-438a-a23f-6b44aa26eabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578ce49c-f637-48fe-ab01-ac6f3afb8a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578ce49c-f637-48fe-ab01-ac6f3afb8a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef49e6a7-83b6-4752-8a91-b003c99e662b', 'volume_name': 'volume-ef49e6a7-83b6-4752-8a91-b003c99e662b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a54da7-6299-44df-ad5a-e645cd28f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a54da7-6299-44df-ad5a-e645cd28f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2c9d08-709a-44d6-a94e-8390def0c68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:48 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Volume ef49e6a7-83b6-4752-8a91-b003c99e662b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef49e6a7-83b6-4752-8a91-b003c99e662b', 'volume_size': 1}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Created reservations ['274eceef-1ab9-4bdc-9fe5-b0fd7311ad38', '9a5ee739-713a-4299-a631-e17b6e60cda6', 'd8de6b6f-48c8-42ce-8aa9-96a98bb03b21', '50e57933-34ef-4e77-9d35-bdbfb62a0f78'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:48 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:48 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d 1073741824" returned: 0 in 0.533s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:49 devstack sudo[108775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d
Jul 31 15:07:49 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:49 devstack sudo[108776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:49 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:49 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d" returned: 0 in 0.258s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1397165950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef49e6a7-83b6-4752-8a91-b003c99e662b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5bd5e074f14c3493c7faef7da9a64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:49Z,use_quota=True,user_id='714cc0085d384fe9a937c0b7b4a6a975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Creating volume ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:49 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:49 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.263s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65374945-7b6b-490b-b246-fac5f9d6707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882e25d1-7f64-429b-af02-a8df1ab23a3d', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:49 devstack sudo[108781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b 1073741824
Jul 31 15:07:49 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f134b49-5ee9-48f7-b3e5-b489bce75e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:07:49 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Volume volume-882e25d1-7f64-429b-af02-a8df1ab23a3d (882e25d1-7f64-429b-af02-a8df1ab23a3d): created successfully
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f134b49-5ee9-48f7-b3e5-b489bce75e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Flow 'volume_create_manager' (53a5596e-aabd-4936-b376-1480f9c6e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-21402629-2549-40b9-985c-cd70c10751b7 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-6fef1d5c-90e7-448f-8990-5052025f0e9d-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:49 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-37198cac-a6e1-440f-9144-456d9ef257d4 tempest-ProjectReaderTests-859008750 None] Created volume successfully.
Jul 31 15:07:49 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b 1073741824" returned: 0 in 0.413s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:49 devstack sudo[108787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b
Jul 31 15:07:49 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:49 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b" returned: 0 in 0.240s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:49 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2c9d08-709a-44d6-a94e-8390def0c68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef49e6a7-83b6-4752-8a91-b003c99e662b', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a9b464-7c46-40d4-9974-508391ffbf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:50 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Volume volume-ef49e6a7-83b6-4752-8a91-b003c99e662b (ef49e6a7-83b6-4752-8a91-b003c99e662b): created successfully
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a9b464-7c46-40d4-9974-508391ffbf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Flow 'volume_create_manager' (5b060fae-98a3-4554-a7ac-6f6db80b8ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:50 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-aa1d67e3-a8e7-40a7-9485-e9d5e6873c08 tempest-SnapshotDependencyTests-1585011240 None] Created volume successfully.
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (51399197-e9fb-468a-8939-3b8b7ab5618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c5ae9a-74b5-4f29-a648-c6531d19a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Creating offline snapshot e4bb7ff4-9848-4fa9-99e0-763f5255d645 of volume 882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c5ae9a-74b5-4f29-a648-c6531d19a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543713338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a58bb1-6178-459b-9610-79a3b6df7851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:51Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f36124-548c-421c-85b6-542b2b49bcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f36124-548c-421c-85b6-542b2b49bcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4038f8e4-1d27-4d37-9af5-4d618f9fb5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4038f8e4-1d27-4d37-9af5-4d618f9fb5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a58bb1-6178-459b-9610-79a3b6df7851', 'volume_name': 'volume-60a58bb1-6178-459b-9610-79a3b6df7851', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9860426e-9931-4038-a0e9-7cefee6608ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9860426e-9931-4038-a0e9-7cefee6608ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a922b3dd-899a-48a9-a720-6494dd87768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:50 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Volume 60a58bb1-6178-459b-9610-79a3b6df7851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a58bb1-6178-459b-9610-79a3b6df7851', 'volume_size': 1}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7770392a-af10-412f-97aa-e7c01d3f35d7]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:50 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:50 devstack sudo[108790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d
Jul 31 15:07:50 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:51 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d" returned: 0 in 0.373s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:51 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 1G
Jul 31 15:07:51 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:51 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 1G" returned: 0 in 0.407s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882e25d1-7f64-429b-af02-a8df1ab23a3d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:51 devstack sudo[108801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882e25d1-7f64-429b-af02-a8df1ab23a3d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645
Jul 31 15:07:51 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:51 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882e25d1-7f64-429b-af02-a8df1ab23a3d -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645" returned: 0 in 0.281s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:51 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 is being set with open permissions: ugo+rw
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:51 devstack sudo[108806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645
Jul 31 15:07:51 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:51 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645" returned: 0 in 0.239s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:51 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:52 devstack sudo[108809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.info
Jul 31 15:07:52 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:52 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.info" returned: 0 in 0.250s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:52 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.info is being set with open permissions: ugo+rw
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:52 devstack sudo[108812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.info
Jul 31 15:07:52 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:52 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.info" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543713338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a58bb1-6178-459b-9610-79a3b6df7851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:51Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Creating volume 60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:52 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:52 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 1073741824
Jul 31 15:07:52 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:52 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6049f88f-39ff-4e19-b92a-f65c65b73f2a tempest-ProjectReaderTests-859008750 None] Create snapshot completed successfully
Jul 31 15:07:52 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 1073741824" returned: 0 in 0.402s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:52 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:52 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851
Jul 31 15:07:52 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:53 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.103s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a922b3dd-899a-48a9-a720-6494dd87768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a58bb1-6178-459b-9610-79a3b6df7851', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77f20f0-b06f-4815-aac9-86d3c65e522e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Creating offline snapshot 82e9c911-5832-419e-b369-2ccd01212b48 of volume ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:53 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Volume volume-60a58bb1-6178-459b-9610-79a3b6df7851 (60a58bb1-6178-459b-9610-79a3b6df7851): created successfully
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77f20f0-b06f-4815-aac9-86d3c65e522e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (51399197-e9fb-468a-8939-3b8b7ab5618f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87aa376-6509-408b-9eb1-e231a425b041]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:53 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-757c9646-e2f5-4284-a027-e1a668fd1bc8 tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:07:53 devstack sudo[108824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b
Jul 31 15:07:53 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-e4bb7ff4-9848-4fa9-99e0-763f5255d645-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Lock "cinder-e4bb7ff4-9848-4fa9-99e0-763f5255d645-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-882e25d1-7f64-429b-af02-a8df1ab23a3d" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:53 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b" returned: 0 in 0.402s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-882e25d1-7f64-429b-af02-a8df1ab23a3d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-e4bb7ff4-9848-4fa9-99e0-763f5255d645" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:53 devstack sudo[108829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 1G
Jul 31 15:07:53 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-e4bb7ff4-9848-4fa9-99e0-763f5255d645" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Deleting offline snapshot e4bb7ff4-9848-4fa9-99e0-763f5255d645 of volume 882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] snapshot_file for this snap is: volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea7ce10-73ca-45ea-8f79-e11989747c5c]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:53 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:53 devstack sudo[108831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645
Jul 31 15:07:53 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:54 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 1G" returned: 0 in 0.439s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef49e6a7-83b6-4752-8a91-b003c99e662b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:54 devstack sudo[108838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef49e6a7-83b6-4752-8a91-b003c99e662b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48
Jul 31 15:07:54 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:54 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645" returned: 0 in 0.435s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-882e25d1-7f64-429b-af02-a8df1ab23a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8752e8-773a-44d6-8c58-355f1e3c07a2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:54 devstack sudo[108841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d
Jul 31 15:07:54 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:54 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef49e6a7-83b6-4752-8a91-b003c99e662b -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48" returned: 0 in 0.316s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:54 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 is being set with open permissions: ugo+rw
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:54 devstack sudo[108846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48
Jul 31 15:07:54 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:54 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d" returned: 0 in 0.355s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:54 devstack sudo[108851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645
Jul 31 15:07:54 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:54 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48" returned: 0 in 0.258s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:54 devstack sudo[108854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.info
Jul 31 15:07:54 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:54 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645" returned: 0 in 0.355s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:54 devstack sudo[108860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645
Jul 31 15:07:54 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:54 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.info" returned: 0 in 0.260s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:54 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.info is being set with open permissions: ugo+rw
Jul 31 15:07:54 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:55 devstack sudo[108862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.info
Jul 31 15:07:55 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:55 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d.e4bb7ff4-9848-4fa9-99e0-763f5255d645" returned: 0 in 0.243s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-e4bb7ff4-9848-4fa9-99e0-763f5255d645" released by "_delete_snapshot" :: held 1.492s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-882e25d1-7f64-429b-af02-a8df1ab23a3d" released by "delete_snapshot" :: held 1.527s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:55 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.info" returned: 0 in 0.252s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.386s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot 44ab7c91-d740-4f33-8f7c-f8a407a97bae of volume 60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:07:55 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ca76d97b-8974-4c54-9cd2-9a6cfa7755d5 tempest-SnapshotDependencyTests-1585011240 None] Create snapshot completed successfully
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b586c76f-c570-41e1-8b10-b0dd67f28770]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Created reservations ['f01641b3-9dc6-4c84-95d9-5e5a8f6eaa3a', '299df214-842e-48b5-96d7-78e383dda746', 'e188b377-6583-407e-8051-25abe26f321b', '5f2259f3-82e0-48b6-8054-baa1c5b0e35c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:55 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Delete snapshot completed successfully.
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e43d2b84-e3d1-47e3-8181-2f69af098cfe tempest-ProjectReaderTests-859008750 None] Lock "cinder-e4bb7ff4-9848-4fa9-99e0-763f5255d645-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:55 devstack sudo[108866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851
Jul 31 15:07:55 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:55 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851" returned: 0 in 0.382s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:55 devstack sudo[108871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae 1G
Jul 31 15:07:55 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-882e25d1-7f64-429b-af02-a8df1ab23a3d-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Lock "cinder-882e25d1-7f64-429b-af02-a8df1ab23a3d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Acquiring lock "cinder-quobyte-882e25d1-7f64-429b-af02-a8df1ab23a3d" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-882e25d1-7f64-429b-af02-a8df1ab23a3d" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6937f9-6001-4869-96e9-67bf000a94c5]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:55 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:56 devstack sudo[108876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d
Jul 31 15:07:56 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:56 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae 1G" returned: 0 in 0.414s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a58bb1-6178-459b-9610-79a3b6df7851 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:56 devstack sudo[108878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a58bb1-6178-459b-9610-79a3b6df7851 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae
Jul 31 15:07:56 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:56 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d" returned: 0 in 0.430s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:56 devstack sudo[108887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d
Jul 31 15:07:56 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:56 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a58bb1-6178-459b-9610-79a3b6df7851 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae" returned: 0 in 0.317s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:56 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae is being set with open permissions: ugo+rw
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:56 devstack sudo[108889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae
Jul 31 15:07:56 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:56 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-882e25d1-7f64-429b-af02-a8df1ab23a3d" returned: 0 in 0.303s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Lock "cinder-quobyte-882e25d1-7f64-429b-af02-a8df1ab23a3d" released by "delete_volume" :: held 0.820s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:56 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae" returned: 0 in 0.288s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:56 devstack sudo[108893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.info
Jul 31 15:07:56 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Created reservations ['1da4f5f6-e43c-431a-b644-34b3d2799150', '6a429b3c-800b-4571-a6a2-cb2574818e34', '8bcb6e01-225c-4497-b5c4-2244b26da98b', '797febb1-84af-4480-ba0b-1ce4870d7a60'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:56 devstack sudo[108895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:56 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:56 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Flow 'volume_create_manager' (47f342ce-1e5e-432c-88ba-ba1e4667ec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4c26c8-03a9-4b3b-9e04-6ae841158e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4c26c8-03a9-4b3b-9e04-6ae841158e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f605476-e3fb-48a7-b24a-c904c26fd7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5bd5e074f14c3493c7faef7da9a64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82e9c911-5832-419e-b369-2ccd01212b48,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:07:57Z,use_quota=True,user_id='714cc0085d384fe9a937c0b7b4a6a975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:57 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c486f36-1c39-4254-a374-376d316984bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c486f36-1c39-4254-a374-376d316984bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650aff1a-e1a1-4a04-814f-31e1bd9fb86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650aff1a-e1a1-4a04-814f-31e1bd9fb86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f605476-e3fb-48a7-b24a-c904c26fd7dc', 'volume_name': 'volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc', 'volume_size': 1, 'snapshot_id': '82e9c911-5832-419e-b369-2ccd01212b48'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7c016c-f00e-4f4f-8dbc-66cc83806d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7c016c-f00e-4f4f-8dbc-66cc83806d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00a4699-fd21-472c-a129-ec7b09107751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:07:57 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Volume 9f605476-e3fb-48a7-b24a-c904c26fd7dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc', 'volume_size': 1, 'snapshot_id': '82e9c911-5832-419e-b369-2ccd01212b48'}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.info" returned: 0 in 0.373s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:57 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.info is being set with open permissions: ugo+rw
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:57 devstack sudo[108898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.info
Jul 31 15:07:57 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:57 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.347s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Deleted volume successfully.
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6f118745-0ef3-463e-9b15-de9d36d9bd20 tempest-ProjectReaderTests-859008750 None] Lock "cinder-882e25d1-7f64-429b-af02-a8df1ab23a3d-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:07:57 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.info" returned: 0 in 0.287s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.284s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-quobyte-82e9c911-5832-419e-b369-2ccd01212b48-9f605476-e3fb-48a7-b24a-c904c26fd7dc" by "_create_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-82e9c911-5832-419e-b369-2ccd01212b48-9f605476-e3fb-48a7-b24a-c904c26fd7dc" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Creating volume 9f605476-e3fb-48a7-b24a-c904c26fd7dc from snapshot 82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-quobyte-9f605476-e3fb-48a7-b24a-c904c26fd7dc" by "_copy_volume_from_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:57 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e97c3891-0960-40ca-a5d1-2f486598d098 tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-9f605476-e3fb-48a7-b24a-c904c26fd7dc" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] snapshot: 82e9c911-5832-419e-b369-2ccd01212b48, volume: 9f605476-e3fb-48a7-b24a-c904c26fd7dc,  {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0613af1-a34d-456a-8884-441f3d3d26cb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:57 devstack sudo[108902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48
Jul 31 15:07:57 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:57 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48" returned: 0 in 0.399s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef49e6a7-83b6-4752-8a91-b003c99e662b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[841378bd-2afb-4bac-802e-e946a3545d2d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:57 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:58 devstack sudo[108909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:07:58 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:58 devstack sudo[108908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b
Jul 31 15:07:58 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-44ab7c91-d740-4f33-8f7c-f8a407a97bae-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Lock "cinder-44ab7c91-d740-4f33-8f7c-f8a407a97bae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-60a58bb1-6178-459b-9610-79a3b6df7851" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-60a58bb1-6178-459b-9610-79a3b6df7851" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-44ab7c91-d740-4f33-8f7c-f8a407a97bae" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-44ab7c91-d740-4f33-8f7c-f8a407a97bae" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot 44ab7c91-d740-4f33-8f7c-f8a407a97bae of volume 60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[53862ba6-90a6-44a6-aae0-eabfc8e583bd]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:58 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.328s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 31 15:07:58 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b" returned: 0 in 0.427s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Creating direct copy from snapshot {{(pid=88594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.utils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Path /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc not found in is_blk_device check {{(pid=88594) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:58 devstack sudo[108917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc
Jul 31 15:07:58 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:58 devstack sudo[108912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae
Jul 31 15:07:58 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:58 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae" returned: 0 in 0.483s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60a58bb1-6178-459b-9610-79a3b6df7851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bec1836-4a4e-42d7-ac61-c8017a3b2efc]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:07:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:58 devstack sudo[108926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851
Jul 31 15:07:58 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:07:59 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root
Jul 31 15:07:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851" returned: 0 in 1.062s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:07:59 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:07:59 devstack sudo[108939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae
Jul 31 15:07:59 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:00 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae" returned: 0 in 0.915s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:00 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:00 devstack sudo[108944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae
Jul 31 15:08:00 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:01 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:01 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851.44ab7c91-d740-4f33-8f7c-f8a407a97bae" returned: 0 in 0.650s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-44ab7c91-d740-4f33-8f7c-f8a407a97bae" released by "_delete_snapshot" :: held 3.266s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-60a58bb1-6178-459b-9610-79a3b6df7851" released by "delete_snapshot" :: held 3.316s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:01 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Created reservations ['691cbc33-79d4-4423-aaca-def2fde89eb9', '589f1dfe-7c9b-4e32-bf01-0619c9211f93', 'fe37ef88-262e-4a85-bf9e-18692918c984', 'bfee7b50-cc33-48c8-bb4b-f80189e7646d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:01 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:08:01 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-16573bca-cb04-405e-a977-e4aaf48fa4da tempest-ProjectMemberTests-1779150627 None] Lock "cinder-44ab7c91-d740-4f33-8f7c-f8a407a97bae-delete_snapshot" released by "delete_snapshot" :: held 3.692s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-60a58bb1-6178-459b-9610-79a3b6df7851-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-60a58bb1-6178-459b-9610-79a3b6df7851-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-60a58bb1-6178-459b-9610-79a3b6df7851" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:02 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-60a58bb1-6178-459b-9610-79a3b6df7851" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:02 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97b063-dd42-445a-93b2-33751c5ae26e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:02 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:03 devstack sudo[108948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851
Jul 31 15:08:03 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (0a0713ba-e1f1-470c-8a9a-62b11adb8a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8404fa-9410-4b75-8f5e-f71366510fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8404fa-9410-4b75-8f5e-f71366510fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180922815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61787c0-a0c9-49a7-aa7c-58db14950117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:03Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cfe09e-3180-44e7-a6f3-959661544eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cfe09e-3180-44e7-a6f3-959661544eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47d2599-44da-4ecd-9e56-89b7898f1eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47d2599-44da-4ecd-9e56-89b7898f1eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61787c0-a0c9-49a7-aa7c-58db14950117', 'volume_name': 'volume-c61787c0-a0c9-49a7-aa7c-58db14950117', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104f0a07-18c3-4a41-b335-cc99f6a742a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104f0a07-18c3-4a41-b335-cc99f6a742a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c316ae8-7977-4423-a81b-27ca0e8ffb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:03 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Volume c61787c0-a0c9-49a7-aa7c-58db14950117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61787c0-a0c9-49a7-aa7c-58db14950117', 'volume_size': 1}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:03 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc" returned: 0 in 5.285s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.image.image_utils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Image conversion details: src /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc {{(pid=88594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 31 15:08:03 devstack cinder-volume[88594]: INFO cinder.image.image_utils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Converted 1024.00 MB image at 193.67 MB/s
Jul 31 15:08:03 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc is being set with open permissions: ugo+rw
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:03 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851" returned: 0 in 0.739s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:03 devstack sudo[108953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc
Jul 31 15:08:03 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:03 devstack sudo[108954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851
Jul 31 15:08:03 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:03 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:03 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-60a58bb1-6178-459b-9610-79a3b6df7851" returned: 0 in 0.244s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-9f605476-e3fb-48a7-b24a-c904c26fd7dc" released by "_copy_volume_from_snapshot" :: held 6.470s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-60a58bb1-6178-459b-9610-79a3b6df7851" released by "delete_volume" :: held 1.110s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-82e9c911-5832-419e-b369-2ccd01212b48-9f605476-e3fb-48a7-b24a-c904c26fd7dc" released by "_create_volume_from_snapshot" :: held 6.553s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.577s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180922815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61787c0-a0c9-49a7-aa7c-58db14950117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:03Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Creating volume c61787c0-a0c9-49a7-aa7c-58db14950117 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:03 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:03 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:04 devstack sudo[108959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117 1073741824
Jul 31 15:08:04 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00a4699-fd21-472c-a129-ec7b09107751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc', 'volume_size': 1, 'snapshot_id': '82e9c911-5832-419e-b369-2ccd01212b48'}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0512fab6-75e8-4598-9bb5-969fb8ad0c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Created reservations ['f07548f2-1592-4d22-bd14-34e55103a4b9', 'df8cbd53-377a-48df-b7b4-ee04e14702b8', 'db484e3b-0f8e-4003-af18-6f949c66d96a', '113c2848-f9fa-4512-88a1-829e6f575a53'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:04 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Volume volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc (9f605476-e3fb-48a7-b24a-c904c26fd7dc): created successfully
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0512fab6-75e8-4598-9bb5-969fb8ad0c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Flow 'volume_create_manager' (47f342ce-1e5e-432c-88ba-ba1e4667ec6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-6ded91fe-fb5b-42b5-afc2-b5084382fadc tempest-SnapshotDependencyTests-1585011240 None] Created volume successfully.
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:04 devstack sudo[108961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:04 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:04 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.259s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:08:04 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117 1073741824" returned: 0 in 0.426s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01842563-f9dc-4b63-942d-3b7b8e184a53 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-60a58bb1-6178-459b-9610-79a3b6df7851-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:04 devstack sudo[108968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117
Jul 31 15:08:04 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:04 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117" returned: 0 in 0.239s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c316ae8-7977-4423-a81b-27ca0e8ffb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61787c0-a0c9-49a7-aa7c-58db14950117', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7810aa-e18d-47ec-9f7c-19cbf841a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:04 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Volume volume-c61787c0-a0c9-49a7-aa7c-58db14950117 (c61787c0-a0c9-49a7-aa7c-58db14950117): created successfully
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7810aa-e18d-47ec-9f7c-19cbf841a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (0a0713ba-e1f1-470c-8a9a-62b11adb8a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:04 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f2f95309-c3df-441c-b71a-81a921e9a5ee tempest-ProjectReaderTests-2025168630 None] Created volume successfully.
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-82e9c911-5832-419e-b369-2ccd01212b48-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-82e9c911-5832-419e-b369-2ccd01212b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-quobyte-ef49e6a7-83b6-4752-8a91-b003c99e662b" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-ef49e6a7-83b6-4752-8a91-b003c99e662b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-quobyte-82e9c911-5832-419e-b369-2ccd01212b48" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-82e9c911-5832-419e-b369-2ccd01212b48" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Deleting offline snapshot 82e9c911-5832-419e-b369-2ccd01212b48 of volume ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] snapshot_file for this snap is: volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249ddd4-342a-4d98-813e-95d02fa179ad]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:04 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:04 devstack sudo[108971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48
Jul 31 15:08:04 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:05 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48" returned: 0 in 0.363s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef49e6a7-83b6-4752-8a91-b003c99e662b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[42389fb3-b37e-402d-8885-f62454047aa3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:05 devstack sudo[108976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b
Jul 31 15:08:05 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (f7697944-d9cc-4ba8-89f4-720a89684fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fb7731-34e0-433f-a125-340f5ba86238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fb7731-34e0-433f-a125-340f5ba86238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861321149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152b7ba4-562c-4c03-a9bd-04a1825fe74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:05Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2013d0c4-486e-4ed7-a34f-4a50fa122622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2013d0c4-486e-4ed7-a34f-4a50fa122622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f35f352-7d26-4521-89d3-2835cfae5be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f35f352-7d26-4521-89d3-2835cfae5be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152b7ba4-562c-4c03-a9bd-04a1825fe74a', 'volume_name': 'volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4afce8-641d-484d-908f-1f4896e4389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4afce8-641d-484d-908f-1f4896e4389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bdc5b3-82bd-433e-a04b-2eaaa2c5ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:05 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Volume 152b7ba4-562c-4c03-a9bd-04a1825fe74a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a', 'volume_size': 1}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861321149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152b7ba4-562c-4c03-a9bd-04a1825fe74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:05Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Creating volume 152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:05 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-c61787c0-a0c9-49a7-aa7c-58db14950117-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:05 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a 1073741824
Jul 31 15:08:05 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-c61787c0-a0c9-49a7-aa7c-58db14950117-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-quobyte-c61787c0-a0c9-49a7-aa7c-58db14950117" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-c61787c0-a0c9-49a7-aa7c-58db14950117" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3415bf-7270-4147-8d3e-0ea7c26a601f]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:05 devstack sudo[108982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117
Jul 31 15:08:05 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:05 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b" returned: 0 in 0.614s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:05 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:05 devstack sudo[108989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48
Jul 31 15:08:05 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:06 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a 1073741824" returned: 0 in 0.467s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:06 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117" returned: 0 in 0.418s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:06 devstack sudo[108995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a
Jul 31 15:08:06 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:06 devstack sudo[108999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117
Jul 31 15:08:06 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:06 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48" returned: 0 in 0.370s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:06 devstack sudo[109002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48
Jul 31 15:08:06 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:06 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a" returned: 0 in 0.261s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bdc5b3-82bd-433e-a04b-2eaaa2c5ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bd527a-15c2-4d6b-9aa1-7827605de33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:06 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:06 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Volume volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a (152b7ba4-562c-4c03-a9bd-04a1825fe74a): created successfully
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bd527a-15c2-4d6b-9aa1-7827605de33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (f7697944-d9cc-4ba8-89f4-720a89684fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-c61787c0-a0c9-49a7-aa7c-58db14950117" returned: 0 in 0.292s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-c61787c0-a0c9-49a7-aa7c-58db14950117" released by "delete_volume" :: held 0.761s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ff25ca7e-c4b6-479c-8fd8-5825f6928c4c tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Created reservations ['a8df8ee7-a45e-40fb-86c6-0fd4308db6f8', 'a3b74f94-02c1-4ba8-b23a-0e36f9098f95', '85aaa43d-a8f5-454b-a2ef-827824e167cb', 'd01bafea-1a10-4165-9930-3bbaa4f77dab'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:06 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b.82e9c911-5832-419e-b369-2ccd01212b48" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:06 devstack sudo[109009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:06 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-82e9c911-5832-419e-b369-2ccd01212b48" released by "_delete_snapshot" :: held 1.761s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-ef49e6a7-83b6-4752-8a91-b003c99e662b" released by "delete_snapshot" :: held 1.784s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Created reservations ['3063c6b8-f119-4955-8278-1e3f66460606', 'd01ec1c2-a617-47b2-8c5d-572eb8c15da3', '614a1813-120b-4083-97bc-9a0d16fef0b7', 'e1edcae4-dc6a-4c3e-a89e-89ecb011bb0c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Delete snapshot completed successfully.
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-69ea74ea-6c7b-4754-a7ee-f3b3fc943e9b tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-82e9c911-5832-419e-b369-2ccd01212b48-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:06 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:06 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Deleted volume successfully.
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-2a2849ae-ddaa-454d-a6c3-be1b381ea2a7 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-c61787c0-a0c9-49a7-aa7c-58db14950117-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-ef49e6a7-83b6-4752-8a91-b003c99e662b-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:06 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-ef49e6a7-83b6-4752-8a91-b003c99e662b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-quobyte-ef49e6a7-83b6-4752-8a91-b003c99e662b" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-ef49e6a7-83b6-4752-8a91-b003c99e662b" acquired by "delete_volume" :: waited 0.023s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99cbb4-4eac-498b-87da-51e833856f92]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:07 devstack sudo[109012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b
Jul 31 15:08:07 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (39973d4c-c6f4-4c9b-8fdd-0bc8e6306610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc663d25-20fc-4735-99fa-921bcc2de444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc663d25-20fc-4735-99fa-921bcc2de444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087709289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a64d93-a8ef-450f-9d42-cefc27848e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:07Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9103e33-3760-4b98-8fab-dd5a99832174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9103e33-3760-4b98-8fab-dd5a99832174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71966bf8-af9c-41ed-8471-3294edba85e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71966bf8-af9c-41ed-8471-3294edba85e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a64d93-a8ef-450f-9d42-cefc27848e7a', 'volume_name': 'volume-82a64d93-a8ef-450f-9d42-cefc27848e7a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c04792d-b13e-44e4-aaa0-d5b617c99d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c04792d-b13e-44e4-aaa0-d5b617c99d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112ba77f-5714-465e-ba2f-22c484e9a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:07 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Volume 82a64d93-a8ef-450f-9d42-cefc27848e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a64d93-a8ef-450f-9d42-cefc27848e7a', 'volume_size': 1}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087709289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a64d93-a8ef-450f-9d42-cefc27848e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:07Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Creating volume 82a64d93-a8ef-450f-9d42-cefc27848e7a {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:07 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:07 devstack sudo[109014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a 1073741824
Jul 31 15:08:07 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:07 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b" returned: 0 in 0.375s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:07 devstack sudo[109019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b
Jul 31 15:08:07 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:07 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-ef49e6a7-83b6-4752-8a91-b003c99e662b" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-ef49e6a7-83b6-4752-8a91-b003c99e662b" released by "delete_volume" :: held 0.766s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:07 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a 1073741824" returned: 0 in 0.501s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Created reservations ['d5d948d3-9e22-4e65-88a4-c964af2ce454', '5eb105df-3ff2-4a34-9595-bb8daf3ca9c0', 'ee441c39-61c2-443b-ab33-4f32f6531933', '564bf4a6-5289-4300-867e-5eb6de91f22d'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:07 devstack sudo[109026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a
Jul 31 15:08:07 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:07 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:07 devstack sudo[109028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:07 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:08 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.353s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-9f605476-e3fb-48a7-b24a-c904c26fd7dc-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112ba77f-5714-465e-ba2f-22c484e9a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a64d93-a8ef-450f-9d42-cefc27848e7a', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8e55fe-171d-405a-bc36-083a26aaffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot e3e77769-3417-4150-bcf9-61871fbc11d7 of volume 152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-9f605476-e3fb-48a7-b24a-c904c26fd7dc-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:08 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Volume volume-82a64d93-a8ef-450f-9d42-cefc27848e7a (82a64d93-a8ef-450f-9d42-cefc27848e7a): created successfully
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8e55fe-171d-405a-bc36-083a26aaffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (39973d4c-c6f4-4c9b-8fdd-0bc8e6306610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a4493e-4952-40dd-807a-cac076451123]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:08 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.315s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:08 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-060c27ce-77dc-4af7-a233-88b91e886ac0 tempest-ProjectReaderTests-2025168630 None] Created volume successfully.
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:08 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Deleted volume successfully.
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "cinder-quobyte-9f605476-e3fb-48a7-b24a-c904c26fd7dc" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-00fc855e-f500-4f63-b312-ee0a7b135b5e tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-ef49e6a7-83b6-4752-8a91-b003c99e662b-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-9f605476-e3fb-48a7-b24a-c904c26fd7dc" acquired by "delete_volume" :: waited 0.020s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b947d3-f7ed-4f06-a741-1eb6cd9a591e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:08 devstack sudo[109032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a
Jul 31 15:08:08 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:08 devstack sudo[109033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc
Jul 31 15:08:08 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:08 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a" returned: 0 in 0.401s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:08 devstack sudo[109041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 1G
Jul 31 15:08:08 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:08 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc" returned: 0 in 0.376s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:08 devstack sudo[109044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc
Jul 31 15:08:08 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:08 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9f605476-e3fb-48a7-b24a-c904c26fd7dc" returned: 0 in 0.258s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:08 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-quobyte-9f605476-e3fb-48a7-b24a-c904c26fd7dc" released by "delete_volume" :: held 0.675s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Created reservations ['e85a463a-48aa-4978-a4cb-528b4e353c43', '334da651-1faf-4274-b0be-10f8ca98941c', '249cf6f7-c503-4d70-944a-90169c045746', '8e3965fe-b987-4f55-80cf-c75d078afa2b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:09 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 1G" returned: 0 in 0.442s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:09 devstack sudo[109051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:09 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:09 devstack sudo[109053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:09 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:09 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.267s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:09 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Deleted volume successfully.
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-3615d73e-9b26-49ce-ac0d-486b606f3d58 tempest-SnapshotDependencyTests-1585011240 None] Lock "cinder-9f605476-e3fb-48a7-b24a-c904c26fd7dc-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-82a64d93-a8ef-450f-9d42-cefc27848e7a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:09 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7" returned: 0 in 0.424s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:09 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 is being set with open permissions: ugo+rw
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-82a64d93-a8ef-450f-9d42-cefc27848e7a-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:09 devstack sudo[109060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7
Jul 31 15:08:09 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-quobyte-82a64d93-a8ef-450f-9d42-cefc27848e7a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-82a64d93-a8ef-450f-9d42-cefc27848e7a" acquired by "delete_volume" :: waited 0.021s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[995b70ab-5314-4ceb-a28c-3b4c82339f58]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:09 devstack sudo[109062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a
Jul 31 15:08:09 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:09 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7" returned: 0 in 0.274s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:09 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:09 devstack sudo[109065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.info
Jul 31 15:08:09 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:10 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a" returned: 0 in 0.393s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:10 devstack sudo[109072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a
Jul 31 15:08:10 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:10 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.info" returned: 0 in 0.272s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:10 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.info is being set with open permissions: ugo+rw
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:10 devstack sudo[109074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.info
Jul 31 15:08:10 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:10 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-82a64d93-a8ef-450f-9d42-cefc27848e7a" returned: 0 in 0.283s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-82a64d93-a8ef-450f-9d42-cefc27848e7a" released by "delete_volume" :: held 0.735s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Created reservations ['fa7c7e75-829f-4815-a744-bd3f14871752', '8f7e85d0-cfc2-41f0-8263-29a372599cfe', '3341c0dc-0b35-45bb-b64e-8ad8bc100eea', 'b67cafdd-5c2f-4216-84ea-56ae97f9e154'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:10 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.info" returned: 0 in 0.299s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-a405224a-5115-481e-854a-cb8dafddbd28 tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:10 devstack sudo[109078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:10 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:10 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.274s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:10 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Deleted volume successfully.
Jul 31 15:08:10 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-7d746810-03a9-4bb6-bc47-ede1c3440481 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-82a64d93-a8ef-450f-9d42-cefc27848e7a-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-e3e77769-3417-4150-bcf9-61871fbc11d7-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Lock "cinder-e3e77769-3417-4150-bcf9-61871fbc11d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-152b7ba4-562c-4c03-a9bd-04a1825fe74a" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-152b7ba4-562c-4c03-a9bd-04a1825fe74a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-e3e77769-3417-4150-bcf9-61871fbc11d7" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-e3e77769-3417-4150-bcf9-61871fbc11d7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot e3e77769-3417-4150-bcf9-61871fbc11d7 of volume 152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e27cea5-8c8f-4c21-aecd-e5c168773319]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (cac3a5df-f340-4905-bfb9-26a0f4a5e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913fbd0-03e7-4769-aa01-1919d4c9977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913fbd0-03e7-4769-aa01-1919d4c9977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792929721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aeb9557-e68a-4029-af49-df66ef3f2db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:11Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58543e1-f79e-425a-977c-cdaf609b6801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58543e1-f79e-425a-977c-cdaf609b6801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d03f1d6-da48-4b5b-92eb-0d3f1863017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d03f1d6-da48-4b5b-92eb-0d3f1863017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aeb9557-e68a-4029-af49-df66ef3f2db5', 'volume_name': 'volume-1aeb9557-e68a-4029-af49-df66ef3f2db5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a24573-2624-4dda-be4a-ef6e11b27c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a24573-2624-4dda-be4a-ef6e11b27c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8918c64f-8d91-443b-8564-2a2f2a12aae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:11 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Volume 1aeb9557-e68a-4029-af49-df66ef3f2db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aeb9557-e68a-4029-af49-df66ef3f2db5', 'volume_size': 1}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792929721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aeb9557-e68a-4029-af49-df66ef3f2db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:11Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Creating volume 1aeb9557-e68a-4029-af49-df66ef3f2db5 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:11 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:11 devstack sudo[109082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7
Jul 31 15:08:11 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:11 devstack sudo[109083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5 1073741824
Jul 31 15:08:11 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:11 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7" returned: 0 in 0.402s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[267faa02-d220-4247-a917-d9dbe42828f2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:11 devstack sudo[109092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a
Jul 31 15:08:11 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:11 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5 1073741824" returned: 0 in 0.489s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:11 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:11 devstack sudo[109095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5
Jul 31 15:08:11 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:12 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a" returned: 0 in 0.441s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:12 devstack sudo[109101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7
Jul 31 15:08:12 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:12 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5" returned: 0 in 0.323s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8918c64f-8d91-443b-8564-2a2f2a12aae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aeb9557-e68a-4029-af49-df66ef3f2db5', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663164ab-b279-4a48-afcf-3bcc8e4041c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:12 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Volume volume-1aeb9557-e68a-4029-af49-df66ef3f2db5 (1aeb9557-e68a-4029-af49-df66ef3f2db5): created successfully
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663164ab-b279-4a48-afcf-3bcc8e4041c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (cac3a5df-f340-4905-bfb9-26a0f4a5e57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c7a470fa-d825-49c3-a28c-a6d97853518f tempest-ProjectReaderTests-2025168630 None] Created volume successfully.
Jul 31 15:08:12 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7" returned: 0 in 0.433s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:12 devstack sudo[109107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7
Jul 31 15:08:12 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:12 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a.e3e77769-3417-4150-bcf9-61871fbc11d7" returned: 0 in 0.274s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-e3e77769-3417-4150-bcf9-61871fbc11d7" released by "_delete_snapshot" :: held 1.671s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-152b7ba4-562c-4c03-a9bd-04a1825fe74a" released by "delete_snapshot" :: held 1.699s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Created reservations ['3662af70-3e42-4fa3-8eb7-e7717f2f3c42', '379b6136-2df8-4f3e-9dcb-f6a2a05e4f05', '135643b4-45e4-4693-b185-c9527b7bfc8a', '13283f42-9468-4be2-9169-379fbe45ad9b'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:12 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:08:12 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-9794a393-f225-4101-93a6-6562bdf834de tempest-ProjectMemberTests-1779150627 None] Lock "cinder-e3e77769-3417-4150-bcf9-61871fbc11d7-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-152b7ba4-562c-4c03-a9bd-04a1825fe74a-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Lock "cinder-152b7ba4-562c-4c03-a9bd-04a1825fe74a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-1aeb9557-e68a-4029-af49-df66ef3f2db5-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-152b7ba4-562c-4c03-a9bd-04a1825fe74a" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-1aeb9557-e68a-4029-af49-df66ef3f2db5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-152b7ba4-562c-4c03-a9bd-04a1825fe74a" acquired by "delete_volume" :: waited 0.026s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd27eaa-1476-44a0-a373-71776b41a5cb]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-quobyte-1aeb9557-e68a-4029-af49-df66ef3f2db5" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-1aeb9557-e68a-4029-af49-df66ef3f2db5" acquired by "delete_volume" :: waited 0.022s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b7d92-9e2f-4757-8bfb-1a9689f515ae]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:13 devstack sudo[109112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a
Jul 31 15:08:13 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:13 devstack sudo[109113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5
Jul 31 15:08:13 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:13 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a" returned: 0 in 0.417s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:13 devstack sudo[109120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a
Jul 31 15:08:13 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:13 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5" returned: 0 in 0.432s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:13 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:13 devstack sudo[109125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5
Jul 31 15:08:13 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:14 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-152b7ba4-562c-4c03-a9bd-04a1825fe74a" returned: 0 in 0.253s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-152b7ba4-562c-4c03-a9bd-04a1825fe74a" released by "delete_volume" :: held 0.759s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Created reservations ['6bff9369-3707-4b8d-8a8b-7474dde91389', '54d880da-cbad-490f-8f9e-fd0a3599102c', 'd92170c3-eda2-4e0c-b3e7-892ce6cef152', '77f0c011-df74-43cf-b44b-60cd5146026c'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:14 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-1aeb9557-e68a-4029-af49-df66ef3f2db5" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-1aeb9557-e68a-4029-af49-df66ef3f2db5" released by "delete_volume" :: held 0.764s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:14 devstack sudo[109129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:14 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Created reservations ['a09e5bdd-81fa-40da-9a08-a1d0d2bddadb', '438ffd45-598b-4c5e-bbe3-02861c8505ae', '4b0634ca-7c45-4420-b413-740686c26941', '1682ad9c-86da-4636-88f5-a6317b521ab2'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:14 devstack sudo[109131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:14 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:14 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.380s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:14 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=195,cinder:INSERT=62,cinder:UPDATE=274,cinder:DELETE=19 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-348ba8eb-757b-41df-b956-dae3402f47af tempest-ProjectMemberTests-1779150627 None] Lock "cinder-152b7ba4-562c-4c03-a9bd-04a1825fe74a-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:14 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.411s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:14 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Deleted volume successfully.
Jul 31 15:08:14 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-dfbc0029-3d6e-4ee9-93a0-f8bded534f92 tempest-ProjectReaderTests-2025168630 None] Lock "cinder-1aeb9557-e68a-4029-af49-df66ef3f2db5-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:UPDATE=244,cinder:DELETE=23,cinder:SELECT=200,cinder:INSERT=76 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (abd5e4a3-2223-48fe-8e5e-71d8df963589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afbdcdf-ce58-490a-8bc5-a70f4e616fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afbdcdf-ce58-490a-8bc5-a70f4e616fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154493688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af5014d-d004-4f7c-83ee-d565aef84e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:15Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6220437f-6b0f-438d-a4ff-2a7c510e793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6220437f-6b0f-438d-a4ff-2a7c510e793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66cb9ec-bece-4651-af0e-82bf615b44a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66cb9ec-bece-4651-af0e-82bf615b44a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af5014d-d004-4f7c-83ee-d565aef84e98', 'volume_name': 'volume-9af5014d-d004-4f7c-83ee-d565aef84e98', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09946c6d-453d-4505-b03a-162ef3d080d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09946c6d-453d-4505-b03a-162ef3d080d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889fc21b-f4cd-42e3-9ae1-f2afed0e836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Volume 9af5014d-d004-4f7c-83ee-d565aef84e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af5014d-d004-4f7c-83ee-d565aef84e98', 'volume_size': 1}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154493688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af5014d-d004-4f7c-83ee-d565aef84e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:15Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Creating volume 9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:15 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:15 devstack sudo[109136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 1073741824
Jul 31 15:08:15 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (16b9b882-f11a-4106-89d6-0dbe7400162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2222569-e906-42f1-a935-cead7f582647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2222569-e906-42f1-a935-cead7f582647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166087118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6137891-e759-461e-8ee4-94decfc2d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:15Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c59392-6a58-41f2-80cf-d71e7156ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c59392-6a58-41f2-80cf-d71e7156ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0dfc854-fe5c-4152-8b54-5fc2caa89199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0dfc854-fe5c-4152-8b54-5fc2caa89199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6137891-e759-461e-8ee4-94decfc2d9ca', 'volume_name': 'volume-a6137891-e759-461e-8ee4-94decfc2d9ca', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9525848a-c504-4d62-880c-a2aa8f4175a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9525848a-c504-4d62-880c-a2aa8f4175a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7a96ac-3dc2-4104-948f-d9dda0b2ebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:15 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Volume a6137891-e759-461e-8ee4-94decfc2d9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6137891-e759-461e-8ee4-94decfc2d9ca', 'volume_size': 1}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:15 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 1073741824" returned: 0 in 0.458s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:15 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:15 devstack sudo[109142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98
Jul 31 15:08:15 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:16 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98" returned: 0 in 0.309s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166087118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6137891-e759-461e-8ee4-94decfc2d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7438faf55945b2a9d376b9b0d0dd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:15Z,use_quota=True,user_id='b1e861aac86942a6a951086b7859b178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Creating volume a6137891-e759-461e-8ee4-94decfc2d9ca {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:16 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889fc21b-f4cd-42e3-9ae1-f2afed0e836f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af5014d-d004-4f7c-83ee-d565aef84e98', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd1934b-6a5f-49b7-a53c-d8cec318b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:16 devstack sudo[109145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca 1073741824
Jul 31 15:08:16 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:16 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Volume volume-9af5014d-d004-4f7c-83ee-d565aef84e98 (9af5014d-d004-4f7c-83ee-d565aef84e98): created successfully
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd1934b-6a5f-49b7-a53c-d8cec318b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (abd5e4a3-2223-48fe-8e5e-71d8df963589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:16 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-20b86a20-4434-449a-81b4-4b61cf9c29c4 tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:08:16 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca 1073741824" returned: 0 in 0.509s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:16 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:16 devstack sudo[109151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca
Jul 31 15:08:16 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:17 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca" returned: 0 in 0.255s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7a96ac-3dc2-4104-948f-d9dda0b2ebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6137891-e759-461e-8ee4-94decfc2d9ca', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa654a6-3e87-4ac2-810b-a98aa5879a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:17 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Volume volume-a6137891-e759-461e-8ee4-94decfc2d9ca (a6137891-e759-461e-8ee4-94decfc2d9ca): created successfully
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa654a6-3e87-4ac2-810b-a98aa5879a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Flow 'volume_create_manager' (16b9b882-f11a-4106-89d6-0dbe7400162c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:17 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ebe91df6-2029-4a3f-b11d-6eeabf9639bd tempest-ProjectReaderTests-2025168630 None] Created volume successfully.
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-a6137891-e759-461e-8ee4-94decfc2d9ca-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Lock "cinder-a6137891-e759-461e-8ee4-94decfc2d9ca-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Acquiring lock "cinder-quobyte-a6137891-e759-461e-8ee4-94decfc2d9ca" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f of volume 9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-a6137891-e759-461e-8ee4-94decfc2d9ca" acquired by "delete_volume" :: waited 0.037s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3d0c3-c89b-43b7-ae2f-7c39c724e68a]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b376578-af9f-45ac-ba9d-43e1ba7af8c6]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:17 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:17 devstack sudo[109157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca
Jul 31 15:08:17 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:17 devstack sudo[109155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98
Jul 31 15:08:17 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:18 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca" returned: 0 in 0.442s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:18 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98" returned: 0 in 0.481s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:18 devstack sudo[109166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca
Jul 31 15:08:18 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:18 devstack sudo[109167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f 1G
Jul 31 15:08:18 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:18 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-a6137891-e759-461e-8ee4-94decfc2d9ca" returned: 0 in 0.281s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Lock "cinder-quobyte-a6137891-e759-461e-8ee4-94decfc2d9ca" released by "delete_volume" :: held 0.782s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Created reservations ['89ea181b-b52f-441a-afc6-24daf896a245', '4becd260-975e-4250-adab-87f786f996a4', '883fbfd0-8974-40b7-8ef2-d61400b9267f', 'c752f641-5fd8-4bc7-8871-0d1b84207bd0'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:18 devstack sudo[109175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:18 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:18 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f 1G" returned: 0 in 0.539s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af5014d-d004-4f7c-83ee-d565aef84e98 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:18 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af5014d-d004-4f7c-83ee-d565aef84e98 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f
Jul 31 15:08:18 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:18 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.346s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:18 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Deleted volume successfully.
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e73f5a81-14dd-40ad-9860-a902c6578e5c tempest-ProjectReaderTests-2025168630 None] Lock "cinder-a6137891-e759-461e-8ee4-94decfc2d9ca-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:18 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af5014d-d004-4f7c-83ee-d565aef84e98 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" returned: 0 in 0.395s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:18 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f is being set with open permissions: ugo+rw
Jul 31 15:08:18 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:19 devstack sudo[109183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f
Jul 31 15:08:19 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:19 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" returned: 0 in 0.309s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:19 devstack sudo[109220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.info
Jul 31 15:08:19 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:19 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.info" returned: 0 in 0.341s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:19 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.info is being set with open permissions: ugo+rw
Jul 31 15:08:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:19 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.info
Jul 31 15:08:19 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:19 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.info" returned: 0 in 0.282s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:19 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:20 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-7a8e19db-f61a-4e93-8fb1-c3a3c4bde08b tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Lock "cinder-d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-9af5014d-d004-4f7c-83ee-d565aef84e98" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-9af5014d-d004-4f7c-83ee-d565aef84e98" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f of volume 9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce95eb5-ea50-40e1-b13c-35ebf4f29c34]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:20 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:20 devstack sudo[109228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f
Jul 31 15:08:20 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:21 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" returned: 0 in 0.371s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af5014d-d004-4f7c-83ee-d565aef84e98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2869bda2-59c5-40ad-a171-6e6526d79978]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:21 devstack sudo[109234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98
Jul 31 15:08:21 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:21 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98" returned: 0 in 0.345s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:21 devstack sudo[109240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f
Jul 31 15:08:21 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:21 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" returned: 0 in 0.329s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:21 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:21 devstack sudo[109245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f
Jul 31 15:08:21 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:22 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98.d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" returned: 0 in 0.245s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f" released by "_delete_snapshot" :: held 1.373s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-9af5014d-d004-4f7c-83ee-d565aef84e98" released by "delete_snapshot" :: held 1.396s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Created reservations ['1822560f-7dce-4943-b3ae-4f47cd16329d', '6c2bd406-a65a-4414-950e-428472a00b86', '526a1244-74cf-4842-93a1-3de524bb27c5', '3e0df8fc-ebc7-456d-a7c3-24e9a1766056'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:22 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-f6490cab-ede7-4308-8073-5cd8b80217bb tempest-ProjectMemberTests-1779150627 None] Lock "cinder-d8f205d4-eff5-4aa3-8e8b-9f6815c1c61f-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-9af5014d-d004-4f7c-83ee-d565aef84e98-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-9af5014d-d004-4f7c-83ee-d565aef84e98-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-9af5014d-d004-4f7c-83ee-d565aef84e98" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-9af5014d-d004-4f7c-83ee-d565aef84e98" acquired by "delete_volume" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d1f6d-b3e9-4b01-b960-823d889d3d09]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:22 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:23 devstack sudo[109249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98
Jul 31 15:08:23 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:23 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98" returned: 0 in 0.348s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:23 devstack sudo[109254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98
Jul 31 15:08:23 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:23 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-9af5014d-d004-4f7c-83ee-d565aef84e98" returned: 0 in 0.244s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-9af5014d-d004-4f7c-83ee-d565aef84e98" released by "delete_volume" :: held 0.648s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Created reservations ['84af591c-2a30-44b7-bbf9-47aebcf1520d', '315bde94-e280-448a-86be-386589c5f933', 'dfb3ff94-a8a1-4c21-8a98-88e8ae64811c', 'b025cf7b-6065-4718-93a6-4743bc5517b6'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:23 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:23 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:23 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.240s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:23 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:08:23 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-e14b32b4-3c86-4f01-901e-4d874095f817 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-9af5014d-d004-4f7c-83ee-d565aef84e98-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (44156efc-b1b5-4b32-a79f-90a035bdbc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c24e9b-a739-4ee0-b8aa-30fb8dc9cd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c24e9b-a739-4ee0-b8aa-30fb8dc9cd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1770522417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc0284-1721-4c9d-95c8-855b80a929a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:25Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5076956d-7457-4954-b866-b638e121bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5076956d-7457-4954-b866-b638e121bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad94911-f863-4cfb-aa95-b2afbfd0a14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad94911-f863-4cfb-aa95-b2afbfd0a14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edc0284-1721-4c9d-95c8-855b80a929a3', 'volume_name': 'volume-8edc0284-1721-4c9d-95c8-855b80a929a3', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf5a982-7122-42de-8f7b-02b8ec48079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf5a982-7122-42de-8f7b-02b8ec48079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f4bfb9-596b-4ea0-a6e2-d0ed1c8701ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:24 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Volume 8edc0284-1721-4c9d-95c8-855b80a929a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edc0284-1721-4c9d-95c8-855b80a929a3', 'volume_size': 1}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1770522417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc0284-1721-4c9d-95c8-855b80a929a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:25Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Creating volume 8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:24 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:24 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:24 devstack sudo[109260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 1073741824
Jul 31 15:08:24 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:25 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 1073741824" returned: 0 in 0.406s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:25 devstack sudo[109265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3
Jul 31 15:08:25 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:25 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3" returned: 0 in 0.236s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f4bfb9-596b-4ea0-a6e2-d0ed1c8701ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edc0284-1721-4c9d-95c8-855b80a929a3', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7277d599-144d-4a3e-9d41-3a1b7a074bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:25 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Volume volume-8edc0284-1721-4c9d-95c8-855b80a929a3 (8edc0284-1721-4c9d-95c8-855b80a929a3): created successfully
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7277d599-144d-4a3e-9d41-3a1b7a074bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (44156efc-b1b5-4b32-a79f-90a035bdbc8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:25 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-c41fe30e-71e8-4499-9b93-5fb542d1b5e1 tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot 76814120-643b-4372-9077-99f784483760 of volume 8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b593c4c-32d4-4950-8af4-638ad9e21d5d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:25 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:25 devstack sudo[109268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3
Jul 31 15:08:25 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:26 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3" returned: 0 in 0.344s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:26 devstack sudo[109273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 1G
Jul 31 15:08:26 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:26 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 1G" returned: 0 in 0.391s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edc0284-1721-4c9d-95c8-855b80a929a3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:26 devstack sudo[109285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edc0284-1721-4c9d-95c8-855b80a929a3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760
Jul 31 15:08:26 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:26 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edc0284-1721-4c9d-95c8-855b80a929a3 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760" returned: 0 in 0.287s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:26 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 is being set with open permissions: ugo+rw
Jul 31 15:08:26 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:26 devstack sudo[109290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760
Jul 31 15:08:26 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:27 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760" returned: 0 in 0.234s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:27 devstack sudo[109293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.info
Jul 31 15:08:27 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:27 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.info" returned: 0 in 0.240s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:27 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.info is being set with open permissions: ugo+rw
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:27 devstack sudo[109296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.info
Jul 31 15:08:27 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:27 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.info" returned: 0 in 0.239s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:27 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-bc40e519-7f5b-4545-9148-e43987edac0b tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-76814120-643b-4372-9077-99f784483760-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-76814120-643b-4372-9077-99f784483760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-8edc0284-1721-4c9d-95c8-855b80a929a3" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8edc0284-1721-4c9d-95c8-855b80a929a3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-76814120-643b-4372-9077-99f784483760" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-76814120-643b-4372-9077-99f784483760" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot 76814120-643b-4372-9077-99f784483760 of volume 8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[161460b6-c3af-4474-b238-81f0ecd6b52e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:27 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:28 devstack sudo[109299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760
Jul 31 15:08:28 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:28 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760" returned: 0 in 0.351s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:28 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8edc0284-1721-4c9d-95c8-855b80a929a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:08:28 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfe3fb8-f4da-4bd4-95a3-f312d3f616a9]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:28 devstack sudo[109304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3
Jul 31 15:08:28 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:28 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3" returned: 0 in 0.345s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:28 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:28 devstack sudo[109309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760
Jul 31 15:08:28 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:29 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760" returned: 0 in 0.324s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:29 devstack sudo[109314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760
Jul 31 15:08:29 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:29 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:29 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3.76814120-643b-4372-9077-99f784483760" returned: 0 in 0.240s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-76814120-643b-4372-9077-99f784483760" released by "_delete_snapshot" :: held 1.342s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8edc0284-1721-4c9d-95c8-855b80a929a3" released by "delete_snapshot" :: held 1.362s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:29 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Created reservations ['45071a4b-702e-4e82-9078-699415b59967', '0cba5672-f461-44c7-812b-ca0e0ddb4e9e', '1edbcbce-e265-486a-9953-002dc1bdd83d', 'da6b2b9a-760c-404c-bca3-287eeeefbdb1'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:29 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:08:29 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-8d4e55ed-ef1c-4d2d-ae13-b62734364315 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-76814120-643b-4372-9077-99f784483760-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-8edc0284-1721-4c9d-95c8-855b80a929a3-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-8edc0284-1721-4c9d-95c8-855b80a929a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-8edc0284-1721-4c9d-95c8-855b80a929a3" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8edc0284-1721-4c9d-95c8-855b80a929a3" acquired by "delete_volume" :: waited 0.014s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2c5e6e-eb5d-4f81-800a-3ed65af492d2]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:30 devstack sudo[109317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3
Jul 31 15:08:30 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:30 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3" returned: 0 in 0.359s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:30 devstack sudo[109322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3
Jul 31 15:08:30 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:30 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-8edc0284-1721-4c9d-95c8-855b80a929a3" returned: 0 in 0.240s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-8edc0284-1721-4c9d-95c8-855b80a929a3" released by "delete_volume" :: held 0.653s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Created reservations ['a8927be8-6768-4695-a4a9-79350615c054', '157b7b1f-0a93-4c75-bf19-7b82b503a2fe', '83c61175-cc83-47b6-aa14-3bca69852300', '3df49043-0fa5-45c4-aab4-9ce54a582f93'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:30 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:30 devstack sudo[109325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:30 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:31 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.236s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:31 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-b379a9d6-3d5a-45e5-8553-f69adf8102b4 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-8edc0284-1721-4c9d-95c8-855b80a929a3-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (88726545-97d0-423c-b570-1551d46e2632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c12d037-3ffb-4806-a6d0-0e03e5720a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c12d037-3ffb-4806-a6d0-0e03e5720a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920074633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb34467-4bac-4a4d-9ae3-f710dc49a88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:32Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c97875-7bf2-40a4-9f93-67bff5157a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c97875-7bf2-40a4-9f93-67bff5157a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568a9c7c-3f5f-4899-86a2-d104e70ba9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568a9c7c-3f5f-4899-86a2-d104e70ba9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb34467-4bac-4a4d-9ae3-f710dc49a88f', 'volume_name': 'volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e77fa5-610d-447f-8e5b-d86acb93f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e77fa5-610d-447f-8e5b-d86acb93f92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02627ff-345a-483c-b4e0-8d1cdfadae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:31 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Volume feb34467-4bac-4a4d-9ae3-f710dc49a88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f', 'volume_size': 1}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920074633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb34467-4bac-4a4d-9ae3-f710dc49a88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:32Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Creating volume feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:31 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:31 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:31 devstack sudo[109328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f 1073741824
Jul 31 15:08:31 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:32 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f 1073741824" returned: 0 in 0.400s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:32 devstack sudo[109333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f
Jul 31 15:08:32 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:32 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f" returned: 0 in 0.245s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02627ff-345a-483c-b4e0-8d1cdfadae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3b56b6-78ee-4a94-8492-f7cdccd0258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:32 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Volume volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f (feb34467-4bac-4a4d-9ae3-f710dc49a88f): created successfully
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3b56b6-78ee-4a94-8492-f7cdccd0258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (88726545-97d0-423c-b570-1551d46e2632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:32 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-059cf7a3-f996-4152-b9fe-c50d2bf330e0 tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot c2855e6e-5d8b-4e12-bf4e-144409ff68b3 of volume feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dfc543-a3f7-419a-a843-a7d8b1e49d08]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:32 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:32 devstack sudo[109337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f
Jul 31 15:08:32 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:33 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f" returned: 0 in 0.344s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:33 devstack sudo[109342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 1G
Jul 31 15:08:33 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:33 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 1G" returned: 0 in 0.378s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:33 devstack sudo[109347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3
Jul 31 15:08:33 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:33 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3" returned: 0 in 0.281s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:33 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 is being set with open permissions: ugo+rw
Jul 31 15:08:33 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:33 devstack sudo[109352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3
Jul 31 15:08:33 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:34 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3" returned: 0 in 0.235s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:34 devstack sudo[109355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.info
Jul 31 15:08:34 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:34 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.info" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:34 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.info is being set with open permissions: ugo+rw
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:34 devstack sudo[109358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.info
Jul 31 15:08:34 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:34 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.info" returned: 0 in 0.244s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:34 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-68426308-ef94-486e-953e-159c19e44a8e tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-c2855e6e-5d8b-4e12-bf4e-144409ff68b3-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-c2855e6e-5d8b-4e12-bf4e-144409ff68b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-feb34467-4bac-4a4d-9ae3-f710dc49a88f" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-feb34467-4bac-4a4d-9ae3-f710dc49a88f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-c2855e6e-5d8b-4e12-bf4e-144409ff68b3" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-c2855e6e-5d8b-4e12-bf4e-144409ff68b3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot c2855e6e-5d8b-4e12-bf4e-144409ff68b3 of volume feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:08:34 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e74d41-0dfa-4b0c-8089-a37dcf9a8439]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:35 devstack sudo[109361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3
Jul 31 15:08:35 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:35 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3" returned: 0 in 0.352s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee46b9-4b22-4ec2-ba92-c3502d12839d]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:35 devstack sudo[109366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f
Jul 31 15:08:35 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:35 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f" returned: 0 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:35 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:35 devstack sudo[109371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3
Jul 31 15:08:35 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:36 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3" returned: 0 in 0.330s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:36 devstack sudo[109376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3
Jul 31 15:08:36 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:36 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:36 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f.c2855e6e-5d8b-4e12-bf4e-144409ff68b3" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-c2855e6e-5d8b-4e12-bf4e-144409ff68b3" released by "_delete_snapshot" :: held 1.363s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-feb34467-4bac-4a4d-9ae3-f710dc49a88f" released by "delete_snapshot" :: held 1.383s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:36 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Created reservations ['0508ec82-c3c6-49d9-b22b-207558b0c95c', '0c040e41-a7de-4330-a90d-d04ae2ae0c04', '8572af0c-8c42-4321-8832-99339c6b6e48', '3f10c2fb-f4f8-478b-9b42-9ff459a81b73'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:36 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:08:36 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-61896122-ec54-4d26-81c5-d74a91fa7c21 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-c2855e6e-5d8b-4e12-bf4e-144409ff68b3-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-feb34467-4bac-4a4d-9ae3-f710dc49a88f-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-feb34467-4bac-4a4d-9ae3-f710dc49a88f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-feb34467-4bac-4a4d-9ae3-f710dc49a88f" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-feb34467-4bac-4a4d-9ae3-f710dc49a88f" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dbcbc8-3cc8-4d08-a32d-1e98e8985f38]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:37 devstack sudo[109379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f
Jul 31 15:08:37 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:37 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f" returned: 0 in 0.350s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:37 devstack sudo[109385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f
Jul 31 15:08:37 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:37 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-feb34467-4bac-4a4d-9ae3-f710dc49a88f" returned: 0 in 0.238s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-feb34467-4bac-4a4d-9ae3-f710dc49a88f" released by "delete_volume" :: held 0.644s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Created reservations ['6b681be6-52ee-49f8-8daa-ebcd174e8887', '4495ad65-2443-464a-a979-c248ce44d251', '3e5c44b6-dee3-4cd8-96eb-43cd38fe74af', '03c58836-c66e-49df-8b92-1b7855d86c38'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:37 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:37 devstack sudo[109388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:37 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:38 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.248s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:38 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-1facd6da-080e-458e-979d-02ac607f922c tempest-ProjectMemberTests-1779150627 None] Lock "cinder-feb34467-4bac-4a4d-9ae3-f710dc49a88f-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (04938b6b-18ef-409e-867b-31f47d69c0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d590a002-7478-4a20-9859-9b8dc3ccd4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d590a002-7478-4a20-9859-9b8dc3ccd4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642267363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61db34b3-98f1-4482-83af-853f368f6bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:39Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d71627-a615-48ec-89c2-f44cbce8d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d71627-a615-48ec-89c2-f44cbce8d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90931cc-414e-4dd4-b27e-57d72cc714c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90931cc-414e-4dd4-b27e-57d72cc714c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61db34b3-98f1-4482-83af-853f368f6bb4', 'volume_name': 'volume-61db34b3-98f1-4482-83af-853f368f6bb4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4518fe33-dbe1-41cd-801d-4ae07992eaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4518fe33-dbe1-41cd-801d-4ae07992eaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9a0ffb-a35f-4251-982a-710d2ae7b9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:38 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Volume 61db34b3-98f1-4482-83af-853f368f6bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61db34b3-98f1-4482-83af-853f368f6bb4', 'volume_size': 1}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77cbe523c0e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-31T13:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642267363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61db34b3-98f1-4482-83af-853f368f6bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66868cabc91a43849e504092b1e2122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T13:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T13:08:39Z,use_quota=True,user_id='7047796d9ef2466c98e2008649b578df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2629fad8-679d-479d-97ed-4e4ac5d99740),volume_type_id=2629fad8-679d-479d-97ed-4e4ac5d99740)}" {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Creating volume 61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Selected osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f as target Quobyte volume. {{(pid=88594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 31 15:08:38 devstack cinder-volume[88594]: INFO cinder.volume.drivers.remotefs [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] casted to osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f
Jul 31 15:08:38 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 1073741824 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:38 devstack sudo[109391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 1073741824
Jul 31 15:08:38 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:39 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 1073741824" returned: 0 in 0.406s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:39 devstack sudo[109397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4
Jul 31 15:08:39 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:39 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4" returned: 0 in 0.246s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'} {{(pid=88594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9a0ffb-a35f-4251-982a-710d2ae7b9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61db34b3-98f1-4482-83af-853f368f6bb4', 'volume_size': 1}' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2261ae57-9f06-4c45-8bde-98d2ed89c3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 31 15:08:39 devstack cinder-volume[88594]: INFO cinder.volume.flows.manager.create_volume [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Volume volume-61db34b3-98f1-4482-83af-853f368f6bb4 (61db34b3-98f1-4482-83af-853f368f6bb4): created successfully
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2261ae57-9f06-4c45-8bde-98d2ed89c3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Flow 'volume_create_manager' (04938b6b-18ef-409e-867b-31f47d69c0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 31 15:08:39 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-0bb0b27f-29cd-4a88-a51a-6376b2235f43 tempest-ProjectMemberTests-1779150627 None] Created volume successfully.
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Creating offline snapshot 6ac6ed7f-9814-4bc8-999d-133ad8351af9 of volume 61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a86bc11-b102-4629-91af-c4e14c0e0ca3]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:39 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:39 devstack sudo[109400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4
Jul 31 15:08:39 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:40 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4" returned: 0 in 0.353s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 1G {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:40 devstack sudo[109405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 1G
Jul 31 15:08:40 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:40 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 1G" returned: 0 in 0.395s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61db34b3-98f1-4482-83af-853f368f6bb4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:40 devstack sudo[109411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61db34b3-98f1-4482-83af-853f368f6bb4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9
Jul 31 15:08:40 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:40 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61db34b3-98f1-4482-83af-853f368f6bb4 -F qcow2 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9" returned: 0 in 0.280s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:40 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 is being set with open permissions: ugo+rw
Jul 31 15:08:40 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:40 devstack sudo[109416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9
Jul 31 15:08:40 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:41 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9" returned: 0 in 0.236s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:41 devstack sudo[109419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.info
Jul 31 15:08:41 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:41 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.info" returned: 0 in 0.245s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:41 devstack cinder-volume[88594]: WARNING cinder.volume.drivers.remotefs [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.info is being set with open permissions: ugo+rw
Jul 31 15:08:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.info {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:41 devstack sudo[109422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.info
Jul 31 15:08:41 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:41 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.info" returned: 0 in 0.247s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:41 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:41 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-ae34ecaf-c71c-4246-8530-15381ba1b06d tempest-ProjectMemberTests-1779150627 None] Create snapshot completed successfully
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-6ac6ed7f-9814-4bc8-999d-133ad8351af9-delete_snapshot" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-6ac6ed7f-9814-4bc8-999d-133ad8351af9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-61db34b3-98f1-4482-83af-853f368f6bb4" by "delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-61db34b3-98f1-4482-83af-853f368f6bb4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-6ac6ed7f-9814-4bc8-999d-133ad8351af9" by "_delete_snapshot" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-6ac6ed7f-9814-4bc8-999d-133ad8351af9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Deleting offline snapshot 6ac6ed7f-9814-4bc8-999d-133ad8351af9 of volume 61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] snapshot_file for this snap is: volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 {{(pid=88594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9183e5b-3741-45a9-9c76-516c5d132d3e]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:42 devstack sudo[109425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9
Jul 31 15:08:42 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:42 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9" returned: 0 in 0.350s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.remotefs [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61db34b3-98f1-4482-83af-853f368f6bb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ea090-c596-4be9-b21a-2a236a1e9cd8]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:42 devstack sudo[109431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4
Jul 31 15:08:42 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:42 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4" returned: 0 in 0.356s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:42 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:42 devstack sudo[109437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9
Jul 31 15:08:42 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:43 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9" returned: 0 in 0.349s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:43 devstack sudo[109443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9
Jul 31 15:08:43 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:43 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:43 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4.6ac6ed7f-9814-4bc8-999d-133ad8351af9" returned: 0 in 0.252s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-6ac6ed7f-9814-4bc8-999d-133ad8351af9" released by "_delete_snapshot" :: held 1.396s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-61db34b3-98f1-4482-83af-853f368f6bb4" released by "delete_snapshot" :: held 1.418s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:43 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Created reservations ['3eb5a254-f23c-42ff-8ca4-7805ddc503e3', '8c246a6d-2f49-4497-97b0-be7d3b5c3f63', '1f870afc-5f4f-46db-823d-4a26fe5a733f', 'ddd129cd-44ac-4d26-bb06-e2001c1bd707'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:43 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Delete snapshot completed successfully.
Jul 31 15:08:43 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-01e46c26-10fb-435c-920f-4cdac5e0b545 tempest-ProjectMemberTests-1779150627 None] Lock "cinder-6ac6ed7f-9814-4bc8-999d-133ad8351af9-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-61db34b3-98f1-4482-83af-853f368f6bb4-delete_volume" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-61db34b3-98f1-4482-83af-853f368f6bb4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "cinder-quobyte-61db34b3-98f1-4482-83af-853f368f6bb4" by "delete_volume" {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-61db34b3-98f1-4482-83af-853f368f6bb4" acquired by "delete_volume" :: waited 0.015s {{(pid=88594) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2c5570-e9a1-4d98-87b0-ca1d33338b6b]: (4, 'qcow2') {{(pid=90006) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:44 devstack sudo[109446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4
Jul 31 15:08:44 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:44 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4" returned: 0 in 0.350s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:44 devstack sudo[109451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4
Jul 31 15:08:44 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:44 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83/volume-61db34b3-98f1-4482-83af-853f368f6bb4" returned: 0 in 0.234s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-quobyte-61db34b3-98f1-4482-83af-853f368f6bb4" released by "delete_volume" :: held 0.638s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.quota [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Created reservations ['bbb623e2-5563-4594-b157-87ffe9395766', '3802d787-2da3-4dbe-bd51-c9ee098b5a50', '6c81ce0f-c3ee-494d-a4e6-1b75097b19e5', '61d0fe63-b9f1-4c31-8239-77e745947a81'] {{(pid=88594) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:44 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:45 devstack sudo[109454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:45 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:45 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:45 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.241s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:45 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:45 devstack cinder-volume[88594]: INFO cinder.volume.manager [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Deleted volume successfully.
Jul 31 15:08:45 devstack cinder-volume[88594]: DEBUG cinder.coordination [None req-75492723-51af-4721-9127-3979b4bddd6f tempest-ProjectMemberTests-1779150627 None] Lock "cinder-61db34b3-98f1-4482-83af-853f368f6bb4-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88594) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 31 15:08:54 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:SELECT=62,cinder:UPDATE=75,cinder:INSERT=22,cinder:DELETE=5 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:08:55 devstack cinder-volume[88594]: DEBUG dbcounter [-] [88594] Writing DB stats cinder:DELETE=10,cinder:UPDATE=91,cinder:SELECT=63,cinder:INSERT=23 {{(pid=88594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f': None} {{(pid=88594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG cinder.volume.drivers.quobyte [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76aa7744-2b24-4ea5-ae69-15b5f9e7327f'] {{(pid=88594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.lockutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83 {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 31 15:08:58 devstack sudo[109462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83
Jul 31 15:08:58 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 31 15:08:58 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG oslo_concurrency.processutils [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f610bd3de12955532a814672f971de83" returned: 0 in 0.279s {{(pid=88594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG cinder.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Notifying Schedulers of capabilities ... {{(pid=88594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG oslo_service.periodic_task [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] Running periodic task VolumeManager._thread_info {{(pid=88594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread count: 28 {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 31 15:08:58 devstack cinder-volume[88594]: DEBUG cinder.volume.manager [None req-2c747b53-5456-42a3-aacb-0fcb49bcf7c2 None None] thread info: [<_MainThread(MainThread, started 131717716443264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131717608275456)>, <Thread(Thread-3 (stat_writer), started daemon 131717604169280)>, <Thread(Rabbit-heartbeat, started daemon 131717604946112)>, <Thread(Thread-5 (_runner), started daemon 131717603033408)>, <Thread(Thread-7 (_runner), started daemon 131717603134016)>, <Thread(fd_logger, started daemon 131717601201472)>, <Thread(privsep_reader, started daemon 131717601209088)>, <Thread(tpool_thread_0, started daemon 131717594269376)>, <Thread(tpool_thread_1, started daemon 131717585876672)>, <Thread(tpool_thread_2, started daemon 131717577467584)>, <Thread(tpool_thread_3, started daemon 131717569058496)>, <Thread(tpool_thread_4, started daemon 131717560649408)>, <Thread(tpool_thread_5, started daemon 131717552240320)>, <Thread(tpool_thread_6, started daemon 131717543831232)>, <Thread(tpool_thread_7, started daemon 131717535422144)>, <Thread(tpool_thread_8, started daemon 131717527013056)>, <Thread(tpool_thread_9, started daemon 131717518603968)>, <Thread(tpool_thread_10, started daemon 131717510194880)>, <Thread(tpool_thread_11, started daemon 131717501785792)>, <Thread(tpool_thread_12, started daemon 131717493376704)>, <Thread(tpool_thread_13, started daemon 131717484967616)>, <Thread(tpool_thread_14, started daemon 131717476558528)>, <Thread(tpool_thread_15, started daemon 131717468149440)>, <Thread(tpool_thread_16, started daemon 131717459740352)>, <Thread(tpool_thread_17, started daemon 131717451331264)>, <Thread(tpool_thread_18, started daemon 131717442922176)>, <Thread(tpool_thread_19, started daemon 131717434513088)>] {{(pid=88594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}